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CLINICAL PSYCHOLOGY 1896-1946’ 


By ROBERT A. BROTEMARKLE 


UNLVERSITY OF PENNSYLVANIA 


HE FLIGHT of time brings the 
youngest of the professions, Clini- 
al Psychology, suddenly to the fiftieth 
nniversary of its founding at the place 
f its vrigin, the University of Pennsyl- 
ania. Inspiring, and none the less 
nique, is the fact of the living presence 
f its Founder, Lightner Witmer. We 
e delighted to have you, one of the 
nost representative meetings of psycho- 
ogists ever assembled, members of the 
erican Psychological Association, 
oin with us in our moments of retro- 
pection and celebration. 
The foundations of clinical psycholo- 
are so dependent upon the origins of 
modern, scientific, experimental psycho- 
ogy, that we must consider this the cele- 
bration of all of our professional origins. 
Many of these early contributions and 
eir creators or mid-wives have been 
honored in the literature and noted by 
ecord in our meetings. 
1An address delivered to the Convocation 
of the University of Pennsylvania in commem- 
oration of the fiftieth anniversary of the 
founding of The Psychological Clinic, Septem- 


Our present meeting records the first 
complete meeting of the re-organized 
American Psychological Association; 
fepresenting as a unit the entire profes- 
sion. It will record also the recognition 
of our profession in a most unique way. 
To the best of our knowledge this is the 
first time any University Council has 
called a Convocation for the single pur- 
pose of honoring the psychological pro- 
fession, through the awarding of honor- 
ary degrees to its representatives. These 
representatives truly reflect the origins 
and development of the psychological 
profession basic to the founding of the 
Psychological Clinic in 1896. 

The Department of Psychology at the 
University of Pennsylvania is signifi- 
cantly honored by this privilege. It is 
justifiably proud of the part it played 
in the origins and development of our 
science and profession. . 

Durieg the 1870s a new concept of 
paver was emerging from a philo- 
sophical psychology, and Wundt materi- 
alized the modern, scientific, experimer.- 
tal concept by the establishment of the 
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first psychological laboratory for ex- 
perimentation and research at Leipzig 
in 1879. The concept was equally emer- 
gent in America. James had set up what 
is commonly referred to as “James’s 
room for demonstrational experiments” 
at Harvard by 1876. Hall activated the 
concept by establishment of the second 
psychological laboratory at Hopkins in 
1883. Cattell, Wundt’s first laboratory 
assistant, started work in psychophy- 
sics at Pennsylvania in 1886, and by 
1887 had established the third psycholo- 
gical laboratory. The laboratory at Hop- 
kins closed shortly, leaving the labora- 
tory at Pennsylvania the oldest in con- 
tinuous activity in America. On January 
1, 1889 Cattell was appointed Professor 
of Psychology at Pennsylvania. We all 
recall Cattell’s great pride in this singu- 
lar and original appointment, the first 
professorship in our new profession. The 
University of Pennsylvania is proud of 
its early recognition of the new profes- 
sion. 

The concept of applied psychology 
was equally emergent, and as Wundt 
said, “typically American.” Its anima- 
tion was most compelling to Witmer. 
During his graduate studies with 
Wundt, he sought to do his doctoral 
work on an applied problem. This ended 
in his doing his dissertation in aes- 
thetics, Gealing with the concept of the 
golden section, known to the Egyptians. 
And this at Wundt’s insistence, Had 
Wundt known Witmer’s temperament as 
many of us know it, he surely would 
have claimed credit for the beginnings 
of applied psychology. Witmer returned 
to Pennsylvania to take over Cattell’s 
work. During the academic year 1894-95 
Witmer held a seminar on Child Psycho- 
logy, discussing the typical problems of 
early human behavior. In March of 1896 
he was challenged by a public school 
teacher, Margaret T. Maguire, to solve 
the case problem of a “chronic bad spell- 


er.” This was his first clinic case, and 
gave impetus to the development of the 
post-analytic diagnosis based on clinical 
observation during remedial training. A | 
second problem involved a “speech dis- | 
order,” and Witmer, recognizing his 7 
limitations in speech training, immedi- | 7 
ately secured the services of a clinic | 
teacher. This was the beginning of 
Witmer’s inspiration of a long line of | 
students who were to apply the clinical 
point of view to the various areas and 
patterns of human behavior. ta 
The power of that inspiration is re )@ 
vealed in the twenty-five articles writ- 
ten by former students in Clinical Psy. ' 
chology - Studies in Honor of Lightner © 
Witmer, for the thirty-fifth anniversary ~ 
of the founding of The Psychological )7 
Clinic. j 
In this volume, Dr. Joseph Collins, 
one of Witmer’s closest friends and col- |7 
leagues, gives us an interesting histori- 7 
cal insight in his biographical sketch. 
Speaking of the origins of clinical psy- 
chology, Collins, who knew the psycho- 
logy and psychologists of the day, said, 
“Tn the autumn of 1896, he submitted to 
the American Psychological Association 
a new method of research and instruc 
tion which he called ‘the clinical method 7 
in psychology and the diagnostic method 5 
of teaching.’ He told his auditors that 7 
clinical psychology is derived from the . 
results of an examination of many hu- J 
man beings, one at a time, and that the 7 
analytic method of discriminating men- | 
tal abilities and defects develops an or- 
dered classification of observed behav- 
ior, by means of post-analytic generali- 
zations. He put forth the claim that the Fj 
psychological clinic is an institution for f 
social and public service, for original re- 
search, and for the instruction of stu- f 
dents in psychological orthogenics f 
which includes vocational, educational, 
correctional hygienic, industrial, and so- 
cial guidance. The only reaction he got 
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from his audience was a slight elevation 
of the eyebrows on the part of a few of 
the older members.”’ 

The history of the Clinic is well 


Pknown. The first decade was clearly and 
concisely recorded by Witmer in Volume 


I of the journal, The Psychological Clin- 
ic, which he founded in 1908. Fernber- 
ger brought the record to date in 1931 
in the Witmer volume. The last 15 years 
records the retirement of Witmer in 
1937, the continuing expansion of the 
york under Twitmyer until his sudden 
eath in 1943, and the present expan- 
sion which is typical of the demands be- 
ing made upon the profession today. 
The rapid development of clinical psy- 
hology could not have occurred had not 


fits fundamental methods, procedures, 


echniques and point of view been so 

learly and concisely stated by its foun- 
der. The history of science reveals few 
such pointed and compelling pronounce- 
ments. The history of psychology will 
record this as the greatest tribute to the 
keen mental analysis of Witmer. 

Clinical psychology’s basic point of 
riew is qualitative. This qualitative em- 
phasis upon the teleological or purposive 

oncept of human behavior is best word- 

ed by Witmer: “A psychological diag- 
mosis is an interpretation of the observed 
behavior of human beings.” “Human 
psychology is an examination of man’s 
spiritual nature. The unit of observa- 
tion is a performance, but the unit of 
consideration is personality, defined by 
the perfectability of behavior, which is 
measured or estimated in units of pro- 
gress which men make toward the per- 
fection which they prefer.” 

Clinical psychology has not in any 
wise avoided the quantitative point of 
view ; it has however been most insistent 
upon the proper understanding of its 
usefulness and limitations. Quantitative 
measures are clearly and precisely de- 
fined. They tell us the amount of beha- 


vior performed, and what status this 
production gives to the individual when 
he is compared to his standard group or 
level; and both within the limits of de- 
terminable probabilities. It gives an ex- 
cellent answer to “what” the individual 
did, and “where” this performance 
places him in his group distribution. It 
gives no information whatsoever as to 
“how” he did what-he did. Knowledge of 
the “how” of behavior is the result of a 
post-analytic diagnosis, based upon clin- 
ical observation. It alone permits a 
functional qualitative interpretation. 

The methodology of clinical psycholo- 
gy has been enriched by the experience 
of the years. Fundamentally it is deter- 
mined by the same post-analytic diag- 
nostic or remedial teaching or training. 
To date, its en:phasis has been predomi- 
nantly corrective. For years this correc- 
tive approach was largely pursued 
through directive methods. Of late years 
greater emphasis has been placed upon 
the indirect method, which Witmer 
characteristically called the “creative”— 
and which few have understood to mean 
for him the insightful self-direction of 
the individual moving on from one 
“stage of perfection’, to the higher lev- 
els of “perfectability” of which the in- 
dividual was capable. 

The greatest failure of clinical psy- 
chology in methodology has been due to 
its preoccupation with the corrective 
point of view, and its almost total ig- 
noring of Witmer’s early emphasis upon 
the preventative point of view. Now and 
then we have made an attempt toward 
prevention, but we have been lacking in 
confidence. I suspect that this lack of 
confidence is due to what has been our 
greatest failure, — the dearth of com- 
prehensive research, directed toward 
fundamental problems rather than the 
hasty searching for immediate applica- 
tions. 

After fifty years, and in spite of the 
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present shortage of clinical psycholo- 
gists, preoccupation with demanding, 
time-consuming cases is little excuse. 
Nor is it any excuse that each indivi- 
dual case examination and therapy is an 
experimentation in itself. This merely 
gives emphasis to the method of clinical 
psychology, and convicts us of failure to 
plan and execute the research basic to 
our progress. It is true that we have 
been dependent upon systematic, experi- 
mental psychology for the development 
of research techniques, procedures and 
statistical devices; and it is true that 
these means have not met our need. This 
dependence is more clearly marked to- 
day than ever, by our insistence that 
clinical psychologists must have sound 
basic training in experimental psycho- 
logy. During the last five years the work 
of experimental psychologists has been 
so closely related to applied psychology 
that I am confident of their understand- 
ing, and predict that we need only make 
our demands sufficiently loud and insis- 
tent to secure the means we need. 

I recently epitomized the history of 
clinical psychology as — 1896, “a case of 
bad spells” — 1946, “a spell of bad 
cases.” From the case of a “chronic bad 
speller,” we have progressed to the most 


prodigious demand by the Veterans Ad ¢ 


ministration for clinical psychologists t; 7 
aid with America’s worst spell of neure | 
psychiatric cases. 


ag 


In 1946, it is most encouraging to se |7 ; 


at hand the developing possibility o 
more extensive clinical research. Ow 


training programs now include opportu. | 4 


nities for practicum training in th) 


form of internships. Institutions |¥ 


schools, business and other agencies of. | 


fering internship opportunities, are pre |7 
senting evidence not only of the oppor.” 
tunity for research, but their insistene | 7 
that well-planned comprehensive re 


search must be undertaken. The pro’ . 


gram for the training of clinical psycho 
logists in our Veterans Hospitals is a 
excellent example of this opportunit; | 5 
and demand. It is the by-product of the 


thinking- of representative clinical psy- 7 


chologists, in summary of the develop |” 
ment of our profession over a perio |” 
of fifty years, and the need for bette > 
training for the years to come. It is pre J 
dictive of the open door of progress a 7 
we enter upon the years in which ow 

preventative contribution to human at. § 
justment may become the crowning 7 


glory of its Founder’s planning. 





CLINICAL PSYCHOLOGY AND PSYCHIATRY’ 


By LAURANCE F. SHAFFER 


TEACHERS COLLEGE, COLUMBIA UNIVERSITY 


HIS MEETING commemorates the 
founding of the first psychological 
linic by Lightner Witmer, a psycholo- 
vist. Without detracting from the honor 
paid to Witmer, it might be noted that 
another early and influential clinic was 
established by a psychiatrist. In 1909, 37 
ears ago, William Healy opened the 
Chicago Juvenile Psychopathic Insti- 
tute, now the Institute for Juvenile Re- 
search. Ever since that time, psychia- 
trists and clinical psychologists have 
been drawn into increasingly complex 
relationships, because of their common 
aims and similar principles and meth- 
ods. 

The feeling tone of the relationship 
between clinical psychology and psy- 
chiatry has varied greatly during the 
past fifty years. From the very begin- 
ning there have been examples of cor- 
diality and effective collaboration, as 
seen in the association of William Healy 
with Augusta F. Bronner, and that of 
Aaron J. Rosanoff with Grace H. Kent, 
partnerships that dated from before 
1910. These classic relationships have 
set a pattern for many other collabora- 
tions that are less well known but equal- 
ly fruitful. When two especially compe- 
tent people peeple are thrown into con- 
tinued and intimate contact, they devel- 
op mutual respect, and this is true of a 
psychologist and a psychiatrist, as well 
as of other persons. 

We would only be blinding ourselves 
‘An address delivered at a symposium in 


honor of fifty years of clinical psychology, at 
te University of Pennsylvania, September 3, 


5 


if we asserted that the relation has al- 
ways been so harmonious. Many psychia- 
trists and psychologists have regarded 
each other with mutual suspicion and 
distrust. This antagonism is itself of 
psychological interest. It is well recog- 
nized that we are more irritated by the 
blemishes of our closest relatives than 
we are by the derelictions of strangers. 
Psychologists and psychiatrists give evi- 
dence of a family feud. In extreme in- 
stances they have hated each other with 
an intensity equalled only by a pair of 
middle-aged sisters who are engaged in 
a law-suit over their father’s will. Our 
professional case of sibling rivalry 
should be studied with a view to thera- 
py! 

Let us examine some of the bases of 
discord between psychiatrists and psy- 
chologists. Many examples of it seem to 
originate from dramatic individual in- 
stances. Sometimes these are clashes of 
personalities in which one man feels 
that another is arrogant, or conceited, 
or avaricious, or not entirely honest, or 
just personally unpleasant in an unde- 
fined way. More frequent are anecdotes 
concerning the professional incom- 
petence of particular individuals, of the 
stupid mistakes made by this psycholo- 
gist or by that psychiatrist. A fair- 
minded observer, of course, has to admit 
that these individual shortcomings are 
true. There are unpleasant persons in 
both professions, and both make mis- 
takes from time to time. These particu- 
lar cases seem to mold the attitudes of 
one profession toward the other, but, as 
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psychological research has found in the 
case of other inter-group attitudes, dra- 
matic instances are often not the funda- 
mental determining factors. Something 
must make a psychiatrist want to be- 
lieve that all psychologists are like the 
one whom he dislikes or distrusts. We 
must therefore search for a deeper 
source of the disharmony. 

A very significant difficulty arises 
from the differences between the train- 
ing of psychologists and the training of 
psychiatrists. The divergence of their 
educations is astonishing. Although they 
perform similar professional functions, 
it is possible for them never to have had 
a single semester hour of identical com- 
mon instruction since Freshman Eng- 
lish. It is frequently observed that per- 
sons tend to believe that their own pro- 
fessional preparation is the most appro- 
priate and beneficial; in fact, some sur- 
veys of the opinions of graduate engi- 
neers, psychologists, and others, indi- 
cate that this viewpoint is held widely. 
A basic cause of distrust, therefore, is 
that no member of either profession can 
quite believe in the competence of an- 
other person whose background is so dif- 
ferent from his own. 

In addition to the very general source 
of suspicion, there are particular in- 
adequacies that tend to be emphasized. 
They hurt because they are true. 
Psychiatrists complain especially of the 
variable and unstandardized training of 
psychologists. One clinical psycholo- 
gist may have a doctoral degree and a 
year of internship, but another person, 
also called a clinical psychologist, may 
have only a year of graduate work, with 
meager training beyond elementary tes- 
ting. In fact, a survey not many years 
ago showed that two-thirds of the psy- 
chologists in child guidance clinics had 
only the Master’s degree. Psychiatrists 
may well say that they have no means 
for identifying a really qualified clinical 


psychologist. This trouble is aggravated 
by psychology’s unique semantic diffi- | 
culty. In spite of attempts to name the 
specialties within psychology by adjec- 
tive modifiers, most clinical psycholo- 
gists are known simply as psychologists. 
Other psychologists poll public opinion, | 
select employees, run rats, and conduct 
intricate experiments on the psycho- 
physiology of vision. These are all psy- 
chologists too, but are not clinicians. 
Psychiatrists, who are always medical 


doctors and almost always practi- J 


tioners, cannot understand this diver- 
sity clearly, but see only that even the 
doctoral degree is no evidence of com- 
petence in clinical psychology. 
Another matter of legitimate concern 


to psychiatrists is the ignorance of \Z 


many clinical psychologists in the area 


of medical diagnosis. In helping human 


beings solve their problems, we deal 
with the whole organism. Physiological 
conditions may play a large part in the 
determination of behavior, and few psy- 
chologists have the training and ex- 
perience to detect them reliably. Phy- 
sicians make mistakes in medical diag- 
nosis too, but their education has pre- 
pared them specifically for this task. 
The proper complaints that psycholo- 
gists make against psychiatrists are 
well known and do not require detailed 
enumeration. Many psychiatrists, es- 
pecially those trained some years ago, § 
are acquainted only with the diagnosis 
and care of the psychoses, and are as 
helpless as laymen in dealing with lesser 
problems of human misery. More than 
one college psychologist has despaired 
when this kind of a psychiatrist has 
sent back an anxiety - ridden student 
who was referred to him, with only a 
statement that there is nothing wrong, 
and that the youngster should engage 
more in social affairs and forget his 
troubles. Psychologists also see that psy- 
chiatrists lack a sound knowledge of ex- 
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perimental psychology, so that they are 
loose in terminology, and are easily at- 
tracted to grotesque theories. Psychia- 
trists usually do not appreciate the val- 
ues of quantitative study, and have 
little knowledge of research methods or 
of the design of experiments. Therefore, 
sound research is lacking in many areas 
of psychiatry, and not a few published 
studies are seriously faulty. 

These broader or corporate clashes 
between psychology and psychiatry, 
which transcend the more annoying but 
trivial ones of personalities, are not un- 
like the conflicts of the international po- 
litical world. Individuals of various na- 
tions can get along together. An Italian 
and a Jugoslav, to select a contemporary 
example, can become real friends. Their 
countries cannot, because of the atti- 
tudes of nationalism and sovereignty 
which hold that nations must not com- 
promise or extend full co-operation, lest 
they lose some transcendent quality of 
their selfhood. In international affairs 
conflicts of sovereign powers are met by 
armed truce, by open warfare, or by the 
development of a dominance-appease- 
ment relationship. The futility of these 
methods for settling international con- 
flict is still fresh in our minds. We hope 
s for a democratic co-operative relation- 
ship among nations as among indi- 
viduals, whereby the welfare of all is en- 
hanced by the surrender of part of the 
sovereignty of each unit. 

But who are we to urge co-operation 
among nations until we can cope with 
the smaller and closer concerns of our 
professional conflicts? Fortunately, a 
beginning has been made in this direct- 
ion. 

In the spirit of the development of a 
democratic — co-operative relationship, 
the two APA’s — the American Psychia- 
tric Association and the American Psy- 
chological Association — appointed com- 
mittees to study the joint concerns of 


the professions. After a year of ground- 
work by correspondence, the two com- 
mittees met in June, 1946, in an atmos- 
phere of mutual acceptance and good 
will. 

The keystone of the solution proposed 
by the joint committees arises from a 
frank recognition of the truth of the ma- 
jor causes for distrust that have already 
been cited. It is true that clinical psy- 
chology lacks uniform standards of 
training and competence. This can be 
remedied by actions already under way, 
in the establishment of the Board of 
Examiners in Professional Psychology. 
It is true that some psychiatrists lack 
skill in dealing with the lesser disorders, 
short of the psychoses. This defect can 
be overcome by training. 

In addition to the obviously reme- 
diable handicaps, there are others not so 
easily cured. It is true that most psy- 
chiatrists lack a background in normal 
and experimental psychology, and are 
deficient in quantitative and research 
methods. It is also true that very few 
psychologists have the medical training 
that is essential to the detection and un- 
derstanding of physiological disorders 
that may underlie maladaptive behavior. 
These weaknesses in the two professions 
cannot be overcome so easily. It might 
be suggested that a new profession 
should emerge, requiring the training of 
both psychiatry and psychology. This 
might mean ten years of graduate study, 
which seems impracticable at the pres- 
ent time. Furthermore, other profes- 
sions have additional claims. Social 
work contributes to the whole under- 
standing of an individual, and a demand 
might be made that the thoroughly 
trained clinician must’ know not only 
psychiatry and psychology, but social 
work as well. This is too large an order. 
Are we then at an impasse? Is there any 
recourse except to continue our inade- 
quacies and our conflicts? 

& 
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No, we are not at an impasse. There 
is an obvious solution to the problem of 
the professional relationships of clinical 
psychology and psychiatry. This solu- 
tion was a major point of agreement 
reached by the joint committee. 

Neither profession is adequate in it- 
self. As a principle and an ideal, the 
joint committees recognize the mutual 
dependence of the two disciplines, in the 
complete description of human person- 
ality, or diagnosis; in the handling of 
persons with deviations, or therapy; 
and in research on problems of human 
behavior. A full diagnosis of each per- 
son involves at least medical, psycholo- 
gical, and social contributions. The same 
basic considerations apply to the area of 
treatment. The interdependence of the 
professions is achieved most fully by 
emphasis upon the concept of team 
work, both in professional practice and 
also in training. This is the proposed so- 
lution. Since neither is self-sufficient, 
the only possible course of action is to 
join forces, so as to provide the most 
effective and the most widely available 
services for human welfare. 

Does this basis for agreement surren- 
der some of the sovereignty of psycho- 
logy? If so, it involves some surrender 
of the sovereignty of psychiatry as well. 
The postulate of team work recognizes 
that professions as well as nations can- 
not realize their full development in iso- 
lation. The relationship that is sought, 
and that seems possible to achieve, is not 
one of conflict, and not one of domi- 
nance-appeasement, but one of demo- 
cratic co-operation. 

In beginning to apply the concept of 
co-operation, the joint committee dis- 
cussed a number of matters relating to 
certification, training, practice, and re- 
search. 

The problem of the identification of 
persons who can properly be regarded 
as well-trained clinical psychologists 


was of special interest to the psychia.” % 


trist members of the joint committe 77 


The qualifications of psychiatrists hav 


been standardized for some time by th: | 
American Board of Psychiatry ani | 


Neurology, so that anyone who can rea 
a list of requirements may know th 
minimum standards of an accredited 
psychiatrist. ‘ 

Up to the present time, the qualifica © 


tions of clinical psychologists have no 4 


been defined at all clearly. The commit © 
tees recognized that before there couli 7 
be any discussion of what a psycholo ~ 
gist is prepared to do, there must bea 7 
more definite conception of what kini — 
of a man or woman we are talkin | 
about. What a clinical psychologist can 
do depends on what a clinical psycholo 
gist is. The committee therefore gav | 
their unqualified endorsement to the~ 
steps now being taken toward the cer-| 
tification of clinical psychologists by an 7 
American Board of Examiners in Pro 7 
fessional Psychology. It was recon- 
mended that only one grade of clinical © 
psychologist should be certified, and 7 
that this certification should require the 
highest standards of training and cor: | 
petence. 
The certification of psychologists is 
inseparable from their training. If we | 
are to maintain the desired equality) 
with the medical profession, the stan¢- | 
ards of education should not be lower § 
than those for medicine. Applicants for | 
certification as clinical psychologists 
should have completed a standard Uni-f 
versity program for a doctorate, plu 
one year of internship. To gain the : 
greatest benefit from the training pre f— 
gram, the committee believed that the f 
sequence should include two years of 
graduate work at the University with 
considerable direct contact with clinicd 
problems, then an internship in the 
third year, and then a return to the Uni & 
versity to complete the doctoral re 
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quirements in a fourth year. There were 
no more detailed recommendations for 
courses of study, as the time is not ripe 
for the crystalization of exact curricula. 


WS Variation and experimentation are de- 


sirable in our present imperfect state of 
knowledge, and the exact content of pro- 
grams should be left to the several Uni- 
versities. 

Many competent clinical psycholo- 
gists now in practice do not meet these 
new requirements. It is especially true 
that very few of us indeed who received 
the doctorate more than ten years ago 
had an opportunity to serve an intern- 
= ship. The committees gave realistic at- 
® tention to the certification of those who 
S have already completed their training. 
This became known as the matter of 
the “grandfather clause”, although 
some of the grandfathers concerned 
may now be at the ripe old age of thirty! 
It is acknowledged that competent cli- 
nical psychologists now practicing may 
be certified, even though they do not 
meet the specific requirements to be de- 
manded of new persons, as professional 
standards are raised. The psychiatrists 
did the same thing only in 1934, and 
they have no objection to our doing it 
now. 

It has been noted that a major cause 
of distrust between psychiatrists and 
clinical psychologists is the radical dif- 
ference in their training, and the isola- 
tion caused by infrequent contacts. The 
committees therefore believe that a 
basic concept in the preparation of both 
psychiatrists and psychologists should 
be that of team work between the two 
professions. This stresses the limi- 
tations of each discipline, and the neces- 
sity for the insights that each offers to 
the total problem. To achieve this end, 
and to insure that future generations of 
psychiatrists and psychologists are not 
strangers to each other, they should be 
trained together. 


There are immediate and serious 
problems in the provision of proper 
training facilities for new members of 
both professions, especially at the in- 
ternship level. The psychiatrists’ com- 
mittee has therefore recommended to its 
parent body that the American Psychia- 
tric Association should refuse to certify 
any center as adequate for the training 
of psychiatrists if it does not have one or 
more certified clinical psychologists on 
its staff, and provision for the training 
of internes in psychology. This co-opera- 
tive move should increase our facilities 
for internship training greatly, and 
should insure the common contact that 
is desired. In turn the American Psycho- 
logical Association may well refuse to 
certify any center as adequate for the 
internship training of clinical psycho- 
logists if it does not have one or more 
psychiatrists who are diplomates. 

These steps are directed chiefly to- 
ward the improvement of training in 
clinical psychology, but psychiatric edu- 
cation also has its shortcomings. Psy- 
chology has had an overbalance of for- 
mal training and a lack of supervised 
practice. Psychiatry has suffered from 
the opposite fault, as its postgraduate 
training has been almost entirely on an 
apprenticeship basis, with little class- 
room instruction. To rectify this, the 
committees recommended that psychia- 
tric training should be supplemented by 
a greater amount of formal and planned 
education. Psychologists with back- 
grounds in both experimental and clini- 
cal psychology should participate in this 
training, by giving instruction in the 
newer trends of objective psychology 
specifically related to an understanding 
of learning, motivation; adjustment, and 
conflict. 

The greatest hope for the future de- 
velopment of co-operation between psy- 
chology and psychiatry lies in te mu- 
tual respect to be cultivated by joint 


” 
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training. In this plan each profession 
contributes its greatest strength to the 
training of both groups, and men learn 
to work together by studying together. 

In addition to the most significant 
principle of team work, the committees 
reached some other agreements on mat- 
ters relating to the practice of psychia- 
try and psychology. In hospital practice, 
the primary responsibility for the pa- 
tient’s care and well-being is easily de- 
fined as medical. In other areas, in- 
cluding educational institutions, clinics, 
and private practice, the responsibilities 
are not so clearly defined. In these areas, 
both psychiatrists and clinical psycholo- 
gists accept some degree of responsibil- 
ity, according to their competences ac- 
quired through training. When either 
psychologists or psychiatrists work 
alone in these fields, it is good practice 
to use all available resources of the 
other professions that can contribute to 
the welfare of those who are served. 

The problem of the administrative 
control of facilities other than hospitals 
was approached realistically by the com- 
mittees. The rapid rise of community 
clinics, educational counseling centers, 
and the like, has resulted in a wide va- 
riety of patterns of administrative or- 
ganization. In various places, a psychia- 
trist, a psychologist, a social worker, or 
an educator may be the responsible ad- 
ministrative officer. The committees rec- 
ognized that there is no essential rela- 
tionship between professional function 
and administrative responsibility, and 
that there is no need for changing the 
present diversity. 

In the area of practice, the commit- 
tees viewed most unfavorably a preva- 
‘Tent tendency to regard what is called 
“personal counseling”, or the handling 
of the so-called “mild” psychoneuroses, 
as areas so simple that they can be 
served by persons with little or no psy- 
chological training. This type of ser- 


vice requires the highest degree of pre 7 
paration and competence on the part of |) 
either a clinical psychologist or a psy- 7 
chiatrist. It is handled most fruitfully 
with a recognition of the interdepen- 
dence of the medical, psychological, and 
social aspects. 

The problem of research in clinica] 
psychology and psychiatry is a basic 
one. Both are pioneer fields, seriously 7 
hampered by limitations in basic know- © 
ledge and in practical techniques. In the 
past we have thought of controlled and 
quantitative research as the primary do- 
main of psychology. Yet during the past 
three years, what psychologist has pro- 7 
duced basic research as significant to | 
clinical psychology as the work of Gantt 
on experimental neuroses, or of Masser- 
man on not only the induction but also 
the therapy of behavior disorders in 
cats? Both of these men are medical doc- 
tors. In the striving of clinical psycholo- 
gy to become a service profession, we 
must not neglect graduate training in 
experimental psychology, in research 
design, and in the sound background of 
general theoretical psychology that is 
essential to research. A clinical psycho- 
logy without constant active research ~ 
would stagnate into a cult, its frontiers @ 
unexplored or left to others. . 

Many important problems of the re 
lationships beteen psychiatry and clini- 
cal psychology remain to be solved. The | 
team work concept is adequate for hos- 7 
pitals and clinics, but what of the indi- 
vidual practitioner? Should a clinical 
psychologist ever practice alone? Is it f 
enough that he work with a physician, [7 
or require that all of his clients first 
have a good medical examination? Or, 
should he always be associated with a 
psychiatrist? Should a psychiatrist in 
private practice always have a psycholo- 
gis a collaborator? If so, what are 
hic <cponsibilities? 

The problem of psychotherapy has 
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also not been clarified sufficiently. In 
diagnosis, it is easy to see the relation- 
ships of a team of physician, psycholo- 
gist and social worker. Each contributes 
elements of understanding not readily 
supplied by the others. Psychotherapy is 
a different matter. It is difficult, or even 
ridiculous, to imagine an individual with 
problems of personal adjustment being 
treated by any team of collaborators. 
Psychotherapy, as best conceived today, 
is a personal relationship, and the 
troubled individual can form this subtle 
association only with one therapist at 
a time. Perhaps a pattern will emerge in 
which the joint efforts of the several 
professions will be directed primarily 
to the diagnosis, and the individual to 
carry on the psychotherapy will be se- 
lected from the team, not because he is 
a psychiatrist or a psychologist or a 


social worker, but because he is the most 
suivable human being to form the thera- 
peutic relationship with a particular 
person who needs help. 

Might it be appropriate to conclude 
with a brief clinical report on the cor- 
porate therapy of psychiatry and psy- 
chology? The patients are not yet en- 
tirely cured of their aggressions, but 
some progress has been made. Rapport 
has been estabkshed, and mutual coun- 
seling has taken place in a most per- 
missive atmosphere. Dependences and 
aggressions have been recognized, accep- 
ted, and even reflected! Considerable 
extinction of old anxieties has taken 
place. The prognosis is hopeful and with 
further treatment the patients, psychia- 
try and psychology, may look forward 
to the expectation of a happy and useful 
life together. 





PSYCHOMETRIC PITFALLS IN CLINICAL PRACTICE’ 


By EDGAR A. DOLL 


THE TRAINING SCHOOL, VINELAND, NEW JERSEY 


T HAS sometimes been said that clin- 

ical psychology is an art which em- 
ploys scientific procedures. The obser- 
vation is sometimes made proudly and 
sometimes disparagingly. Yet there is 
no inconsistency in the statement, for as 
an art clinical practice leans heavily on 
the support of science. But as a science, 
clinical psychology has not yet transcen- 
ded its artistic antecedents. 

This anniversary of the founding of 
the first formally organized psycholo- 
gical clinic in this country marks more 
than the mere passage of years; it 
marks the turn of an era. Present in- 
dications suggest that clinical psycholo- 
gy has come of age. Born under some- 
what dubious circumstances as the out- 
come of an early romance between psy- 
chology and education, this infant prod- 
igy of our time dates the first flir- 
tation of psychology in the fields of ap- 
plication. Our patrician forefathers 
viewed the liaison askance and repeat- 
edly sought to disown the offspring. 
This is perhaps not the place to review 
the childhood and youth of clinical psy- 
chology in the orthopsychiatric clichés 
of paternal rejection, sibling rivalry and 
traumatic episodes. Rather this is an oc- 
casion to welcome this promising youth 
into the company of his academic elders 
along. with those professional siblings 
whose careers, while somewhat less 
stormy, have profited materially from 
the mutual association. 

1An address delivered to a symposium in 


honor of fifty years of clinical psychology, at 
eed University of Pennsylvania, September 3, 
1946. 


Yet few will deny that clinical psy- 
chology has been something of a prob- | 


lem child. Nor has the stripling yet 7 


achieved a fully mature adjustment. It 
seems pertinent to indulge in some self- 
analysis of our present status with due 
reference to anamnestic background and 
prognostic trends. Perhaps in doing so 
we shall discover some suggestions for | 
therapy and regimen which may facili- | 
tate a more favorable outcome than §& 
would otherwise be the case. 

I first became acquainted with clini- 
cal psychology some years ago as un- 
dergraduate laboratory assistant to Guy 
M. Whipple in his years at Cornell when 
his Manual of Mental and Physical Tests 
was the only standard materia psycho- 
metrica for the study of individual dif- 
ferences. It was one of my functions 
to assist in a realistic demonstration 
of the errors of individual measurement. 
The opening exercises in Whipple’s 
manual, as some of you will recall, dealt 
wjth physical measurement as a pre- 
liminary to mental measurement. It was 
one of my functions to serve as the Vp, 
or subject, of these measurements and 
to make such a simple task as the meas- 
urement of height as susceptible to er- 
ror as I could. Accordingly with the 
first observer an unnoticed bending of 
the knee, for the second a stretching of 
the neck, for the third a slump of the 
spine, and so on, served to disturb the 
accuracy of the measurement. The ob- 
servers, meanwhile, absorbed in the nov- 
elty of applying a new technique, were 
characteristically more concerned with 
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the measurement than with the person 
measured. Imagine the astonishment of 
the class when the diversity of measures 
was arrayed. This led into a statistical 
treatment of the measures for central 
tendency and dispersion, which, if I was 
successful, proved to be sufficiently er- 
ratic to point a moral. 
To emphasize the unreliability of 


TS measurement, or shall we say its prob- 


able error, the measurements were 
then repeated. With increasing alert- 
ness on the part of the observers it was 
only somewhat more difficult to contin- 
ue to evade accuracy of measurement. 

You will readily understand that here 
was an object lesson designed to reveal 
the pitfalls of measurement. While this 
illustration reflected only intentional 
dissimulation, the moral was readily ap- 
parent. Whipple would then point to the 
motto on the east wall which read, “You 
can tell by trying.” The class would then 
about face and read the second injunc- 
tion, “But don’t monkey with the meth- 
od.”’ 

Here were the beginnings of precision 
attitudes toward measurement. This les- 
son was carried over into the more 
subtle phases of psychometric effort 
with two major principles at issue, first 
that of always keeping the subject be- 
fore the examiner, and second that of 
emphasizing the variables inherent in 
personal appraisal. For example, in the 
measurement of weight it was my task 
to see that the scales were out of balance 
before I was weighed, thereby encour- 
aging the examiners to insure the ac- 
curacy of their instruments before put- 
ting them to use. 

I recall an episode which illustrated 
the uncertainties of inference in the de- 
tection of guilt. On a certain occasion I 
was asked to inspect one of two boxes in 
the adjoining room. On my return it was 
the task of the class to see if they could 
determine, by means of the association 
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13 


technique, which box I had opened. In 
this little plot I had opened the box 
which contained a revolver but not the 
box which contained an ace of diamonds. 
As the experiment proceeded I was a - 
ready sufficiently hardened in my career 
of dissimulation to evade detection. But 
all stimulus words cued for diamonds 
proved too romantically cathectic. Im- 


- agine the chagrin-of the class in falsely 


convicting me of having viewe’ the ace 
of diamonds; the verdict lacked the ring 
of truth! 

These personal experiences no doubt 
influenced my later and continuing con- 
cern for errors of measurement and for 
errors of inference based on measure- 
ment. Meanwhile clinical psychology 
was outgrowing its infancy and with 
the advent of the Binet scale may be 
said to have entered its later childhood. 
This preadolescent spurt in growth and 
development marks the second epoch in 
the history of our turbulent hero who 
was now sufficiently stalwart to carry 
arms in the first World War. The callow 
youth survived this episode not only 
with astonishing credit, but with a very 
marked accession of adolescent matu- 
rity. He could even complacently ac- 
cept his infant sibling rival of 1920, 
child development, on whom he has 
since attempted to bestow brotherly af- 
fection, though not perhaps with the 
degree of success that might have been 
anticipated. 

As a vigorous young man in the sec- 
ond World War, clinical psychology at- 
tained a stature and an association with 
other relatively novitiate fields of psy- 
chological application, including even 
his critical sire, experimental psycho- 
logy, with such success that today we 
have new promise of honorable status in 
the parental house. Those here present 
who assisted during the confinement, 
nursed the infant, nourished the child, 
and were the boon companions of its 


” 
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adolescence, may well view with pardon- 
able pride the recognition now accorded 
this vigorous stripling. Hail, Pennsyl- 
vania! 

This pride is not unmixed with con- 
cern for the future history of a career 
which might easily be gravely impaired 
unless the integrity of its character is 
soundly established in the worid of 
scientific moral values. We may well 
view with alarm as well as satisfaction 
the extraordinary future which lies 
ahead, and we shall do well to moderate 
our pride with misgivings centering 
around the sense of trust and mission 
which confronts us. 

In one sense all science begins as art, 
namely, the art of observation which 
precedes measurement. We agree with 
McCall that whatever exists exists in 
some amount, and that these amounts 
are susceptible to measurement. But 
we must first observe what exists before 
we can proceed to its measurement. 
That existence may even be only hypo- 
thesized and the real proof of existence 
may perhaps not be attained until ade- 
quate measurement has been accom- 
plished. 

The clinical psychologist is, or at 
least should be, first of all a psycholo- 
gist concerned with the phenomena 
within his professional framework. Psy- 
chometry is the technician aspect of 
clinical psychology. The more success- 
fully objectification, standardization 
and categorical definition are achieved, 
the more completely does the field be- 
come subject to the use of technical 
assistance. This is remarkably wit- 
nessed in the experience of Manson and 
Greyson in the evolution of the psycho- 
logical clinic of the disciplinary train- 
ing center in the Mediterranian thea- 
ter of operations of the U. S. Army, 
where the technician aspects of clinical 
psychology were highly systematized 
and reduced to the level of nonprofes- 
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sional operation. The first pitfall for : 


the clinical psychologist to avoid is this 7 
reduction of his status from clinica 
psychologist to psychometrician. The 


bait in this trap is the scientific idea j 


offered as a substitute for the profes 
sional art. To avoid this the clinica] 7 
psychologist must not yield his patri- 
mony of psychology for the blandish- 
ments of psychometry. 


As we consider the practice of clini- | 4 
cal psychology in its overall aspects, 


with an orientation toward psychometry 
as only one of the means by which the 

ends of practice may be achieved, we 7 
start with Propbst’s concept of the pa- © 


tient as the unit of practice and Wells ~ 


definition of the mental test as a stand- 
ard situation in which the subject may 7 
be psychologically observed. Such client- 7 
centered study and such test-centered 


observation derive from a consideration 9% 


of the total clinical problem, the precipi- 
tating complaint, or the guidance-ori- 


ented attitude. Hence it is necessary © 


first of all to clearly set forth the pur- 
poses involved in the clinical-psychologi- 
cal consideration of the individual cli- 
ent. And it is necessary to establish an 
explicit bill of particulars as to the 
issues to be resolved. This specification 
of the problem immediately leads into 


an estimate of its ramifications based © 
on insightful consideration of the his- | 
tory of the problem and the various | 


stages and concomitants of its develop- 
ment. Coincidentally, the clinical psy- 


chologist indulges in reasonable specula- | 
tion regarding the etiological origins, | 


the behavioral manifestations, and the 
situational circumstances attending the 
matter under consideration. 

At this point the technique of inter- 
view is at maximum operation since it 
provides not only the orientation to 
ward the problem, but also affords 
background information essential to the 
development of explanatory hypotheses. 
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et it is particularly in this field that 
inical psychology has not yet been 
successful in establishing more than 
eager procedures of the order of scien- 
ific merit. Bingham and Moore’s How 
o Interview is a helpful guide, and Paul 
W. Preu’s Outline of Psychiatric Case- 
tudy affords a useful manual. The re- 
ent literature shows some tendency 
oward interview standardization, and 
such an instrument as the Vineland So- 
ial Maturity Scale offers a specific 


: Mtechnique which is useful for laboratory 
Ssinstruction in interviewing. Yet the 


Srange of knowledge and skill required 
for successful interviewing even in nar- 
row areas of practice poses a serious 
obstacle to the successful development 
of standardized interview methods. 


Likewise, the scope of potential cover-. 


age makes the interpretation of inter- 
riew data almost inevitably artistic 
rather than scientific. If we can develop 
he technique of interviewing to the 
present level of psychometry it is not 
0 be doubted that fifty years from now 
we shall write a different chapter not 
only on this topic but on clinical prac- 
tice in general. 
The second pitfall in psychometric 
neasurement is that of selecting the 
tests that may most advantageously be 
resorted to in given clinical situations. 
Is the subject infant or senescent? Male 
or female? Literate or nonliterate? 
With or without sensory or motor 
handicap? Gifted or feebleminded? 
Adjusted or disturbed? Of what race, 
color or nationality? Of what social 
background? And so on? These circum- 
stances‘ will obviously influence the 
choice of tests in respect to which some 
will be impracticable, others irrelevant, 
and still others misleading. Here again, 
the clinical psychologist is an artist se- 
lecting the brushes and pigments most 
appropriate to his canvas. 
There are almost no standard oper- 
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ating procedures which definitively out- 
line with scientific warrant the particu- 
lar battery of tests most likely to prove 
successful in a given case. Nor do we 
have multiple regression equations or 
other satisfactory means for their sci- 
entific evaluation. Perhaps this is the 
reason why some psychologists rely 
completely on some single test which 
happens to be conventionally fashion- 
able. Obviously the selection of the 
most practicable and most relevant tests 
will be determined in large measure by 
the clinician’s speculative orientation 
toward the case, derived from the hy- 
pothetical consideration of the most 
probable or most plausible resolution of 
the clinical problem. Yet if in respect 
to a particular case study one asks the 
clinical psychologist why he employed a 
particular test rather than some other, 
one too often encounters a hurt rejoin- 
der, or an ingenuous astonishment rath- 
er than a rational explanation. “It’s in 
our routine,” they say. But it is one 
thing to use a test for frankly explora- 
tory purposes and quite another to se- 
lect a test with clear design as specially 
relevant to the problem under consider- 
ation. Here, too, we may anticipate that 
the next half-century will reveal marked 
advances in the systematic planning of 
test batteries (or SOP’s) scientifically 
standardized in relation to specific clin- 
ical issues. Indeed as early as twenty- 
five years ago at least one clinical 
laboratory, that at Ohio State Uni- 
versity, was seriously engaged in the 
development of differential clinical syl- 
labi systematically oriented to particu- 
lar types of clinical problems. 

But assume that a suitable battery of 
tests has been agreed upon as repre- 
senting demonstrated scientific merit. 
It is evident that today we have no 
common standardization of these bat- 
teries in respect to the same subjects, 
so that cross-reference from one test to 


le. 
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another may be had in respect to the 
same standardization samples. Undoubt- 
edly a serious task of the future is such 
multiple standardization of test batter- 
ies on identical subjects for equivalence 
of norms and correlational interpreta- 
tion. 

For simplicity of exposition we may 
therefore confine ourselves to the con- 
sideration of single tests, scales, or 
systems. Here the clinical psychologist 
in his psychometric endeavors is faced 
with many problems, each of which 
presents a series of pitfalls besetting 
the steps of the unwary. Let us con- 
sider some of these hazards. 

1. Has the test been normatively 
standardized, and if so on what kind 
and how large a sample? Does the norm 
of central tendency represent a general 
or a particular norm? How has the sam- 
ple been selected? What variables are 
reflected in it? To what extent can 
these variables be allowed for in respect 
to subjects from less generalized sam- 
ples? 

Californians present will not be re- 
luctant to admit that the inhabitants 
of that fair state reflect superior social- 
economic selection. Many evidences sup- 
port this conclusion. And no doubt the 
citizens of Palo Alto will modestly rec- 
ognize that a university community gen- 
erally contains a somewhat more su- 
perior population (from at least the 
standpoint of intelligence) than do most 
industrial or geographically isolated 
areas. It is not therefore too surpris- 
ing that the mean IQ of 100 established 
for most age levels of the 1916 Stan- 
ford has not been duplicated, but rather 
that the mean IQ for wider selections 
of the population proved to be closer to 
85. But the citizens of Millville, New 
Jersey, are at a disadvantage in com- 
parison with those of Palo Alto, and 
consequently it would nut be strange if 
the early mean quotient score of 100 es- 


tablished at successive ages for the 
Porteus Maze might prove to be 115 ip 
other population samples. If these dif. 
ferences in samples are not recognized, 
the individual subject who achieves a 
quotient score of minus one sigma on 
the 1916 Stanford and plus one sigma 
on the early standardization of the Por. 
teus Maze should have this difference 
attributed not to a Stanford — Porteus 
difference but rather to a Palo Alto — 
Millville difference. 

Here again we foresee future resolu- 
tions of these difficulties; indeed the 
1937 Binet specifically attempted to 
achieve a standardization based on a 
national rather than upon a loc2! sanm- 
ple. But what allowance should one 
make in local case studies? Perhaps the 
techniques of market research and opin- 
ion polling will be much more widely 
used in the future than in the past in 
the determination of normative san- 
ples. In any case we may certainly ex- 
pect that the populations employed for 
test standardization will ir the future 
be much more adequately described than 
in the past and by such means as will 
permit some more effective translation 
of equivalent scores than has heretofore 
been practicable. 

2. Whatever the sample, and what- 
ever the test, the results will show both 
a floor and a ceiling, the former reflec- 
ting the minimum effective age or level 
of ability at which the test may be suc- 
cessfully employed and the latter the 
optimum age or asymptote of the mat- 
urational standardization. Both floor 
and ceiling will depend upon the range 
and functions of the test in question and 
upon the selectivity reflected within the 
sample according to the availability of 
normative subjects. The practice of ob- 
taining ceiling samples based on school 
achievement is definitely to be depre- 
cated in view of the school mortality of 
the intellectually or linguistically infer- 
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jor subjects, which results in artificial 
ceilings above those of the total popu- 
lation. Witness again the ceiling stand- 
ard of the 1916 Stanford which logi- 
cally represents the upper quartile rath- 
er than the median of unselected popu- 
lations. When this ceiling was validat- 
ed for more random samples at the 
fourteen-year level, that validation was’ 
not generally accepted. Although now 
validated for the 1937 scale at the fif- 
teen-year ceiling, some states continue 
the legal requirement of employing the 
sixteen-year ceiling. Maturation ceil- 
ings will vary from test to test, and this 
constitutes a serious difficulty in the 
comparison of scores above the lowest 
ceiling in a given test battery. More- 
over, in the measurement of adults 
there is apparent need for recognizing 
the regression of such ceilings to lower 
levels for the period of mental involu- 
tion. 

3. A corollary of the test ceiling is 
evident in the compression effects on 
test performance resulting from the 
limitations of a testing instrument be- 
yond its average maturation ceiling. 
This restricts the attainment of super- 
ior scores as age advances, since the 
range at the upper limit of most tests 
or scales reflects progressively dimin- 
ishing return. Consequently the inter- 
pretation of ceiling scores cannot ig- 
nore the subordinate ages or perform- 
ance levels at which the compression 
effects are observable. Therefore each 
test system must be considered not only 
with reference to its total range but 
also its effective range since the inter- 
pretation of scores at either extreme of 
the scale is more or less hazardous. 

A further aspect of the ceiling score 
is the question of how to express scores 
beyond the normative ceiling. Some test 
systems employ arbitrary systems of 
weighting these post-ceiling scores. 
Others resort to extrapolated scores 


based on the distribution of measures 
in the ceiling sample. Such scores are 
sometimes expressed in sigma units, 
sometimes as percentiles, sometimes as 
extrapolated age scores based on evi- 
dence or assumption of a symmetrical 
distribution. 

These difficulties materially embar- 
rass the interpretation of compared 
scores derived from_tests with unequal 
ceilings. They affect not only test-age 
differences and test-quotient differences, 
but also the deviation differences since 
the normative ogives for different tests 
and test-systems may not be unequivo- 
cally comparable at all points. It is prob- 
able that these difficulties will be re- 
solved by ingenuities of statistical ma- 
nipulation. But such manipulation does 
not always completely resolve all the is- 
sues involved. They are too often com- 
parable to methods of resuscitation 
which maintain breathing but leave the 
victim somewhat waterlogged. 

4. Another hazard is that of test-re- 
test reliability. This measure of relia- 
bility should not be confused (as it so 
often has been) with the split-half meth- 
od of estimating test reliability. Where- 
as the former gives a measure of de- 
pendence on the stability of test scores 
under repeated measurement, the latter 
gives only a measure of consistency 
for one-half of the scale compared 
with the other. Each measure has its 
place but they serve different purposes. 
It is to be expected that in the future 
no test will be considered adequately 
standardized until both these estimates 
of reliability have been employed. Ob- 
viously a test which yields unstable 
scores under repetition must be em- 
ployed with definite reservations. 

5. One of the widest pitfalls in psy- 
chometric measurement is that of the 
probable error of the measure. This ex- 
pression usually includes the variability 
of measurement due to minor sources 
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of error both within and without the 
subject s control. First among these is 
the personal equation of the examiner 
whose personality, clarity of speech, fa- 
cility in test administration, and so on, 
materially affect the subject’s responses. 
Factors emanating from the subject 
himself such as degree of health or fa- 
tigue, amenability to examination, fa- 
cility of response, and the like, material- 
ly influence the entre-nous relationship 
between subject and examiner. It may 
be assumed that all psychologists are 
familiar with the phenomenon of the 
probable error of the measure and that 
they do not confuse this with the prob- 
able error of the distribution. Yet our 
literature is replete with publications on 
comparative test performances which 
wholly ignore this source of error, the 
consequences of which are self-evident 
in any attempt to fix specific cutting 
scores, especially when such classifica- 
tion scores are confused with diagnos- 
tic implications. The attempt to use spe- 
cific IQ’s as limiting points for mental 
deficiency is extraordinary witness of 
the failure to observe the significance of 
the probable error of the measure. We 
ignore here the probable error which at- 
tends gross errors of measurement due 
to faulty examination, dissimulation, 
unresolved effects of various handicaps, 
and so on. 

6. Akin to this difficulty is that of the 
use of deviation scores based on general- 
ized distributions. It is regrettable that 
many test standardizations are not even 
reported in such a manner that devia- 
tion scores can be successfully em- 
ployed. But even where deviation scores 
are available, there is a notorious fail- 
ure to employ them in comparing the re- 
sults of one test with those of another. 
There is a tendency to employ constant 
cutting scores from one test to another 
regardless of the deviation significance 
of such scores. The indiscriminate use 


of quotient scores is a prime source of 
error unless the significance of such 
scores in terms of some equivalent of 
standard deviation is rigorously adhered 
to. This is reflected at its worst in the 
indiscriminate averaging of age scores, 
quotient scores, and percentile scores 
without regard for the nature of the re- 
spective distributions. It is therefore in- 
cumbent upon the clinical psychologist 
when employing psychometric methods 
to be thoroughly familiar with the dis- 
tributive aspects of specific test stand- 
ardization. 

7. Closely allied to the statistical in- 
terpretation of scores is their relation to 
the validity of cutting scores in terms of 
differential standardization, especially 
where diagnostic symptom-complexes 
are at issue. This error has been con- 
spicuously apparent in the attempts to 
employ critical scores for the determin- 
ation of mental deficiency in the use of 
particular test systems without refer- 
ence to the validity of such critical 
scores in relation to the criteria of dif- 
ferential clinical diagnosis. It should by 
this time be almost axiomatic that a 
test has not been sufficiently standard- 
ized for clinical use until it has also been 
validated in terms of the clinical sig- 
nificance of the deviations from its cen- 
tral tendencies. Many clinical symptom- 
complexes show marked overlap in re- 
lation to the uncritical use of critical 
scores. Witness for example the com- 
plete overlap between the moron degree 
of mental deficiency as feebleminded- 
ness and the lower limits of intelligence 
in the normal continuum. There are re- 
latively few critical scores which are 
clinically pathognomonic and it is dif- 
ficult enough to set up multiple pattern 
scores which are consistent with the cri- 
teria of differential mental diagnosis. 
Obviously a particular problem here is 
the determination of suitable criteria 
for the assignment of critical scores 
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with respect to their clinical validity. 
This problem involves a progressive res- 
olution of the issues as our knowledge 
advances both in respect to the clinical 
symptom-complexes and the optimum 
use of psychometric devices. 

8. And what shall we say of the prac- 
tice effects from repeated administra- 
tion of the same test? Some standard’ 
tests are almost immune to practice ef- 
fects, including both the incidental ef- 
fects of repetition and the effects of de- 
liberate coaching, while other tests show 
a marked consequence of such influ- 
ences. The validity of test interpreta- 
tion will be materially affected by the 
extent to which repetition of the same 
test shows practice effects. The inter- 
pretation of practice effects must also 
reckon with the size of the effect in re- 
lation to the time interval between re- 
peated administrations of the same test, 
and for that matter the effect of prac- 
tice in test situations as such in a suc- 
cession of different tests, or what has 
sometimes been called the “test-wise- 
ness” of the subject. The influence of 
practice needs also to be determined in 
relation to age and in relation to the de- 
viation scores themselves. The validity 
value of a test may also be influenced by 
its repeated use. On the other hand, the 
repetition of a test may be an index of 
ability to learn and might in this way 
become clinically useful under suf- 
ficiently sophisticated interpretation. 

For clinical purposes it is not suf- 
ficient that a given psychometric score 
be reliable and valid pro tem. In clinical 
practice, psychometric results are used 
not only to evaluate the present stat: 
of the subject but also to predict his fu- 
ture status. The clinical psychologist 
must therefore be concerned with the 
prognostic value of his psychometric 
scores. Life would be so simple if the IQ 
were really constant for purposes of in- 
dividual prediction! At the race track 


one is not so much interested in the 
average horse as he is in the one on 
which he has placed his bet. Moreover, 
such a race is often won or lost by a 
nose rather than by a length. Shall we 
place our bets any less cautiously on the 
human race? If the individual has an IQ 
of 69 today, what are the chances of his 
having an IQ of 71 later in life if IQ 70 
is to be used as a critical score for men- 
tal deficiency? Obviously such predic- 
tive values would have a relation to the 
probable error of the measure as well as 
to clinical validity for purposes of diag- 
nosis. Here too as experience evolves in 
the years ahead, we shall if sufficiently 
alert have no particular difficulty other 
than that of time for amassing the evi- 
dence in establishing far more accurate 
criteria for prediction than is possible 
at present. But we should not be too sur- 
prised if our colleagues in the field of 
medical diagnosis show some amuse- 
ment at the ingenuousness with which 
we now alter our diagnoses from day to 
day. 

It is as painful to reassert these ob- 
vious dangers in the field of psychomet- 
ric measurement as it is to listen to their 
repeated recital. You know these haz- 
ards and no doubt you present them 
forcefully in your instruction of stu- 
dents. But what shall we say of the ob- 
servance of these difficulties in the lab- 
oratory as opposed to the classroom? 
How genuinely are we concerned to in- 
sure that these sources of error shall not 
vitiate our practice? To paraphrase a 
well-known observation, “The fault is 
not in our tests but in ourselves.” Fifty 
years ago the clinical psychologist was 
in command of his tests: today the tests 
threaten to dominate him. So much has 
been learned in the meantime that, if 
our tests do not suffice to meet our 
needs, at least we liave better ideas as 
to what those needs are and how the 
tests can best be made to serve them. 
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Assuming that the clinical psycholo- 
gist in his use of psychometric measure- 
ment is clearly alert to these pitfalls and 
wary in their avoidance, there yet re- 
mains the problem of interpretation. 
There is no evidence at present, or at 
best only dubious evidence, that psy- 
chometry can replace clinical psychol- 
ogy. At best psychometry is only a stand- 
in for the clinical psychologist. The psy- 
chologist as clinical artist must still con- 
ceive his goal as an achievement in re- 
spect to which mental tests can only be 
the hammer and chisel, but not the 
sculpture. 

We have suggested the difficulties of 
relevant test selection and use. We may 
now deal with their incompatibility for 
interpretation. This immediately raises 
the question of the test patterns for dif- 
ferent aspects of total clinica! consider- 
ation. These patterns have reference to 
the clinical syllabus or SOP in relation 
to particular complaints. But they have 
an internal significance in relation to 
different parts of that syllabus. Thus 
the distinction between mental level (or 
quantity) and mental type (or quality) 
is far from being achieved. Yet it may 
be clinically more important to decide 
whether a person is fluid or crystal in 
mental operation than to estimate the 
level of such operation. Likewise a clin- 
ical diagnosis may fairly be considered 
as incomplete except as it accomplishes 
an etiological as well as a therapeutic 
interpretation of the evidence. 

Such orientation is of relatively re- 
cent date and may be expected to com- 
mand highly profitable attention in the 
years ahead. Yet Witmer in his earliest 
days was an advocate of diagnostic 
teaching. And the Psychological Clinic 
of this University still employs response 
to learning as a highly useful means of 
mental diagnosis. 


We have only begun to capitalize clin- 
ical psychology for psychological ther- 
apy, but the rush of events of the past 
five years has set goals and techniques 
for evaluating the dynamics of personal- 
ity structure and expression which open 
vistas only dimly foreseen in the past. 
One ultimate test of the successful prac- 
tice of clinical psychology is the outcome 
achieved through successful treatment. 
This includes not only therapy but also 
disposition and regimen. The extraor- 
dinary, not to say alarming, demand 
for clinical psychology in the Veterans 
Administration is only one evidence of 
the distance we have gone in the past 
fifty years. If we can meet those de 
mands effectively we may look forward 
to a second half-century in our field 
even more promising than the pioneer- 
ing years behind us. 

It is fitting to close these observations 
with a tribute to The Psychological Clin- 
ic of this University, not only for its 
historical role in the development of clin- 
ical psychology but also for its very 
survival during the unsettled period be- 
hind us. Such a tribute recognizes not 
only the forceful personnel associated 
with this Clinic throughout its history, 
but also witnesses the inherent native 
strength and continuing needs of clini- 
cal psychology itself. 

And perhaps a word is in place re 
specting the courage and vision of those 
other pioneers — Terman, Huey, Wallin, 
Pintner, Goddard and the rest — who 
sowed the seed the reaping of whose 
harvest lies immediately ahead of us. 
Our best work is yet to be done. The 
tasks seem clear and the available tools 
not too badly fashioned. The mar- 
ket is waiting. Our task is to recruit 
promising personnel and to insure suf- 
ficient skill and competence to capi- 
talize the opportunities that so obviously 
confront us. 
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AN EXPERIMENTAL STUDY OF INTELLECTUAL 
CONTROL UNDER STRESS AND ASSOCIATED 
RORSCHACH FACTORS’ 
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HE RORSCHACH method of per- 

sonality examination has gained 
wide recognition in the field of clinical 
psychology, but for the most part has 
yet to gain the whole hearted acceptance 
of the academic and experimental psy- 
chologist. Major criticism of Rorschach 
has centered around the problem of 
validation [17]. The Rorschach pur- 
ports to measure personality, and here- 
in lies the frustrating barrier to valid- 
ation. The task of validation becomes * 
the task of selecting suitable criteria of 
personality. We feel as Beck [4] and 
others [1] that the most meaningful ap- 
proach is by an “operational” criterion 
in which not only the definition of the 
concept of personality itself but also of 
its component processes is in terms of 
constructs of actual behavior. 

In her review of projective methods, 
Sargent [21] outlines three proposed 
methods of investigating validity. Brief- 
ly these are (a) correspondence with 
other criteria, (b) internal consistency, 
and (c) predictive success. Hertz [15] 
suggests four general approaches: name- 
ly, (a) direct experimentation, (b) com- 
parison with independent, objective cri- 
teria,(c) comparison with extensive in- 
dividual case studies, and (d) compari- 
son with known diagnoses and clinical 


1 The writer wishes to express his apprecia- 
tion to Dr. W. A. Hunt, Dr. R. L. French and 
Mr. S. G. Klebanoff for their valuable criticism 
and aid during the development and execution 
of this study. 
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pictures. Consolidating these sugges- 
tions from the viewpoint of providing 
relatively stable and repeatable criteria 
for investigation, two broad groupings 
appear most promising. If we overlook 
the use of internal consistency, which 
usually is applicable only to the group 
measured ; and predictive success, which 
has usually been an uncontrolled and 
unstable criterion, these approaches 
may be classified as (a) the comparison 
of Rorschach findings with clinical find- 
ings and (b) the correlation of Ror- 
schach findings with independent and 
experimentally controlled behavioral 
criteria. 

The first category has been the most 
popular, with clinical studies on groups 
of known intelligence and personality 
picture comprising the bulk of past vali- 
dation work. As criteria these have uti- 
lized clinical diagnosis [7], psychoana- 
lytic data [22], intelligence estimates 
[26], graphology [10], personality 
sketches [27], and case studies [12]. 
Comparisons with these criteria have 
been made by means of qualitative 
analysis [8], matching techniques [28], 
blind diagnosis and blind personality 
analysis [14, 16], and, in some instances, 
statistical correlational techniques [13]. 
Typical of the second category are Ror- 
schach studies of personality changes 
under hypnosis [20] and drug adminis- 
tration [11]. Scattered investigations of 
the correspondence of various Gestalt 
perceptual tests [24], intelligence tests 
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[2], paper-pencil personality tests [25], 
the Lowenfeld Mosaic tests [27], and 
other projective devices [23] also have 
been reported, but no thorough-going 
systematic experimentation has ap- 
peared. It is the lack of such systematic 
experimental investigation in terms of 
an independent, objective criterion de- 
fined behaviorally that has caused the 
experimentalist to turn his back on the 
Rorschach. However strong the confi- 
dence of the clinician in his present 
methods of validation, he cannot long 
afford to overlook the controlled experi- 
mental approach, nor can he ignore the 
possibility of improvement in techniques 
and prediction which such an approach 
may offer. As Beck advises students of 
the Rorschach method: 


... Meanwhile, as a psychologist, by which I 
mean experimentalist, he will exercise over the 
component techniques of the test those cautions 
and controls and canons of orderly method 
which his scientific upbringing have ingrained 
in him. He will constantly criticize and refine 
them. In this way his test will be stably found- 
ed. Or at least he will know how much of it 
can be so founded. That which is not does not 
matter — it will go with the wind in any event. 
But so controlled, the method can be scientific; 
as a whole it can be no stronger than its weak- 
est part. [4, p. 102] 


The experimental study to be re- 
ported in this paper had a two-fold ob- 
jective: (a) to set up an independent 
and standardized criterion situation 
which would yield a quantitative index 
to an operationally defined aspect of 
personality, and (b) to examine the va- 
lidity of those Rorschach factors pri- 
marily associated with this personality 
process in terms of the criterion meas- 
ure. Since the approach of this study is 
relatively novel in Rorschach validation, 
it should be pointed out here that the se- 
lection of the personality process and its 
associated Rorschach factors was not a 
random selection, but was made on the 
basis of a definite set of criteria. These 


were (a) that the definition and inter- 
pretation of the Rorschach factors or 
scoring categories used be relatively 
well agreed upon by various authorities, 
(b) that objective scoring of them be 
possible, (c) that they should yield a 
sufficient range of scores to insure ade- 
quate differentiation, and (d) that they 
be of such nature that a behavioral cri- 
terion for validation might be set up ex- 
perimentally. 

In the analysis of personality by the 
Rorschach method, a major aspect of 
the personality is said to lie in the pic- 
ture of intellectual control afforded by 
certain factors in an individual’s proto- 
col [5, 19]. Intellectual control may be 
defined as that degree to which an indi- 
vidual may efficiently utilize his mental 
processes in the face of strong emotional 
demands. Good intellectual contro! im- 
plies stability of character or, in other 
terms, ability to govern thinking from 
higher centers with conscious attention 
and discerning judgment. Furthermore, 
it infers maintenance of a stable affec- 
tive tonus under pressure of outward 
promptings [9]. Knowledge of this de- 
gree of control enables the clinician to 
attempt an estimate of the vulnerability 
of the personality to external affective 
pressures. From it he may also predict 
future behavior in stressful situations. 

In the Rorschach test, there is general 
agreement by the various “Séhools” that 
two factors, form quality and integra- 
tion of form with olor, offer direct in- 
dices to fiinctional level of control in the 
personality. Thus Beck regards F ‘plus 
percentage or form quality as “an index 
of control over intellectual processes” 
[3]. In more recent publications, he has 
emphasized the value of F plus percent- 
age as the indicator of conscious control 
and of ego strength. He summarizes F 
plus percentage as follows: 


A high F plus percentage goes with a firm 
ego. The relation will be found illustrated in 
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the personality interpretations. The F plus 
potential is thus one of the most important of 
the Rorschach test factors. It is a measure of 
the strength with which the personality has 
organized its values, the force that holds it 
together when disruption threatens, and the 
central directive to which it refers at moments 
of decision. As expressing conscious discrim- 
ination and judgment, it represents activity of 
the higher, the differentiating cortical centers. 
In so far as this activity refers to a set of 
values that the personality identifies with 
itself, it is the central directive that deter- 
mines the personality’s course. The F plus 
score becomes thus tke measure of the stabil- 
ity of the personality. [6, p. 22] 


The second factor, integration of 
form with color, has been recognized by 
Rorschach and others as of great im- 
portance in gauging the emotional ad- 
justment of the individual. Particular 
emphasis has been placed on the dif- 
ferential fusing of form with color 
which is said to characterize the domi- 
nance of either emotion over intelligence 
or vice versa [9]. These responses serve 
to reflect the general state of control of 
the individual under stress from emo- 
tional stimuli. The variations of color 
responses are further termed by Rap- 
paport [19] as representative of the ex- 
tent and modes of control grossly paral- 
leling various forms of affective experi- 
ence and display in everyday life. Beck 
aptly amplifies the significance of these 
variations in terms of developmental 
stages and affective experience, as fol- 
lows: 


The pure C response. This is the reaction mode 
of the infant... Response to feelings is ex- 
clusive and instant. The CF response. This re- 
flects the stage at which the child has become 
conscious of a world outside himself... but the 
center of reference is still himself. He is still 
gratifying himself. 


The FC response. This bespeaks the level of 
the grown person... He is now not egocentric 
but allocentric. The F' plus response. This stage 
may be represented by a hypothetical person 
who has entirely extruded feeling... He is all 
intellect. 


Thus the evolution from all infant to all in- 
tellect. Somewhere between these two extremes 
are the emotional experience patterns of all in- 
dividuals — comprising a modicum of C, more 
or less of CF, and FC, and F plus with- 
out excess. [6, P. 30-31] 


The handling of color is held to be of 
extreme importance in evaluating the 
extent of mental control and affective 
development in the emotional situation. 
The Rorschach worker thus places pri- 
mary emphasis upon the two factors, 
color reactions and F plus percentage, 
in his evaluation of control. Other sec- 
ondary factors, such as productivity, 
organization, average reaction time, 
etc., could also have been considered, 
‘ut this study is confined to the valida- 
tion of the above two major factors in 
terms of an independent, objective cri- 
terion. 


Let us anticipate immediate criticism 
from certain quarters regarding the so- 


called heresy of isolating specific Ror- 
schach factors and concomitant person- 
ality traits. We are not advocating a 
trait psychology for Rorschach. As Beck 
[4] has noted, the issues here are two- 
fold. On one hand, we have the whole, 
the unit personality which operates ac- 
cording to its own principles. On the 
other hand, we have the component per- 
sonality processes which, individually 
operating on their own level, are fused 
and blended together into the various 
complex combinations called personali- 
ties. These may be compared to the 
whole, the Rorschach psychogram, and 
its component processes, the Rorschach 
test factors. Thus, we may study person- 
ality as a whole by consulting the psy- 
chogram or we may investigate the var- 
ious processes by exploring the specific 
test factors. This study attempts to do 
the latter. It seeks validation of certain 
Rorschach factors which are said to 
have relation to an operationally defined 
process, namely, intellectual control. It 
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does not claim to make any investigation 
of the personality as a whole. 


The experimental structure of our be- 
havioral criterion was designed to dup- 
licate our operational definition of intel- 
lectual control. Basically, it was ar- 
ranged so as to provide comparative 
measures of intellectual performance in 
two divergent and standardized situa- 
tions; namely intellectual performance 
under optimum conditions, and intellec- 
tual performance under emotionally 
stressful conditions. The Digit Symbol 
or Digit Substitution Test was selected 
as the quantitative yardstick of per- 
formance. This selection was based on 
the fact that it was possible to bring in- 
dividuals to a relatively stable level of 
performance on this test by a series of 
practice trials. In addition, our choice 
was influenced by the wide recognition 
of the Digit Symbol Test as a measure 
of mental output involving a complex of 
mental components [29], and by its 
ease of administration and scoring. 
Once a stable level of performance was 
established for an individual on this 
measure, it became possible to obtain a 
further measure of performance under 
controlled stress conditions involving 
emotionally toned social and mechanical 
stimuli. The obtained difference between 
stable and stress performance levels 
could thus be made to yield a compara- 
tive index of intellectual control for 
each individual. 


EXPERIMENTAL PROCEDURE 


The experimental population consist- 
ed of 25 white male students, ages 18 
to 28, selected at random from volun- 
teers in Northwestern University ele- 
mentary psychology classes. They were 
informed that they were to undergo two 
sessions of personality investigation, 
the results of which would be held in 
strictest confidence. No further orien- 
tation was given. 
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The experiment was divided into four 
parts given in two sessions. Part A was 
the administration of the Rorschach 
test. Part B was a series of Digit Sym- 
bol practice periods designed to raise 
performance to a stable level. Part C 
was a control period when measures of 
Digit Symbol performance under opti- 
mum conditions were taken. Part D was 
a stress period during which measures 
of Digit Symbol performance under 
stress were obtained. 

A standard Rorschach examination 
was utilized following the instructions 
and procedures recommended by Dr. §. 
J. Beck [5]. On the basis of a prelimi- 
nary experiment? it was determined 
that eight practice trials on the Digit 
Symbol Test were necessary in order to 
rule out most of the effects of learning 
and to raise each subject to approxi- 
mately maximum performance. There- 
fore, two practice sessions were given 
as follows: 

After a five minute rest period fol- 
lowing completion of the Rorschach ex- 
amination, the first practice session was 
begun. Each subject was seated oppo- 
site the examiner and was informed, 
“You are about to be given a test which 
is an index to your general intelligence. 
The test which has been placed before 
you is known as a Digit Symbol Test. It 
is one frequently used in many intelli- 
gence test batteries. You will be given a 
number of trials on this test in which 
we are interested in seeing how high a 


2 Thirty-seven male subjects from a popula- 
tion similar to our experimental group under- 
went a series of trials utilizing test procedure 
and rest pauses identical with those in our 
study. The group learning curve showed a 
minimizing of learning after eight trials. Con- 
tinuation of further trials duplicating our ex- 
perimental design but not utilizing stress 
showed only a small but insignificant increase 
in performance for all 37 subjects. No subject 
exhibited any decrease in performance during 
the trials paralleling the stress period in our 
experiment. 
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score you can reach.”’ The experimenter 
then carried out the standard instruc- 
tions and administration of the Wech- 
sler Bellevue Digit Symbol Test [29]. 
The test was administered five times, 
utilizing 60 second rest pauses between 
trials. The usual 90 second test period 
per trial was used with a Digit Symbol 
Test blank on which the number of test 
items was increased from 67 to 110 by 
repetition of the last 43 items. This was 
done to limit the possibility of any sub- 
ject’s completing the test before the 
time was up, and anticipated the pos- 
sible extended range of scores which re- 
sulted from practice. The second prac- 
tice session took place within 24 to 48 
hours after session one. The instruc- 
tions and procedure were identical with 
session one. Three trials were given at 
this time. 

Following a rest period of three min- 
utes after practice session two, control 
testing was instituted to obtain an aver- 
age measure of maximum performance 
under optimum conditions. With the 
subject in a rested condition, three suc- 
cessive readministrations employing the 
same test and rest periods used pre- 
viously were giveti. 

Upon conclusion of the Control Per- 
iod, each subject was immediately led 
by the experimenter to an adjoining 
building. He was ushered into a room in 
which from three to five persons in- 
cluding at least two females were seated 
before the curtains of a one-way screen. 
The subject was introduced to the occu- 
pants and was informed, “The tests you 
have recently completed will be repeated 
again soon. Meanwhile, I am sure you 
will be interested in the operation of 
this one-way screen. You will notice that 
when I part these curtains you can easi- 
ly observe everything in the next room.” 
(The experimenter opened curtains cov- 
ering a one-way screen eight by four 
feet in size, giving a complete view of 


the adjoining room. A camera mounted 
on a tripod flush with the screen also 
faced directly into the adjoining room.) 
“Now, if you will step into the next 
room and seat yourself at the table 
facing the screen, you can see that you 
are unable to see through the screen 
while anyone on the other side may ob- 
serve you.” (The subject was seated at 
the table facing the screen. The room 
was in complete darkness except for 
two ¢1 Photoflood lamps focused direct- 
ly upon the subject and the table before 
him from a distance of approximately 
three feet.) “Remain seated as you are. 
The rest of this experiment will be con- 
ducted in this room. Hold out your left 
hand, (or right hand if subject wrote 
with left). I am now placing a set of 
electrodes on your hand, the function of 
which will soon be explained.” (A set of 
brass electrodes mounted on an adjust- 
able elastic strap was secured to the 
palm and back of the hand.) “I shall 
now leave the room. All further instruc- 
tions will be given to you through a 
concealed loud speaker. Save any ques- 
tions for the end of the experiment.” 


At this point the experimenter re- 
turned to the outer room and closed the 
door. The subject was seated alone at 
the table in the experimental room. The 
table was set flush with the one-way 
screen, placing the subject and his work 
area within two to three feet of the 
screen. A panel containing a white and 
red light rested on the table directly in 
front of the subject. Wires from the 
electrodes led directly into this panel 
but in reality were connected to a shock 
apparatus (induction coil type) in the 
outer chamber. The panel lights were 
also controlled from the outer chamber. 
A pad of Digit Symbol blanks and a 
number of pencils rested on the table 
before the subject. All further in- 
structions were presented by means of 
a phonograph recording in the outer 
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chamber which was played through an 
amplifier into a concealed speaker in the 
experimental room. The recording was 
utilized in order to standardize the 
stress text presentation. To avoid any 
possibility of contamination, the voice 
used was not that of the experimenter. 
The text of the recording anc the ex- 
perimental procedure were as follows: 

“You are now being observed by a 
number of psychologists on the other 
side of the screen who are taking notes 
and continuous photographs of all your 
reactions throughout the remainder of 
this experiment. All directions are to be 
followed implicitly. Rest your arm at- 
tached to the electrodes on the table 
and keep it there from now on. You will 


notice that the electrodes on your arm -- 


are connected to the panel before you. 
(White light snapped on.) The white 
light which has just gone on indicates 
that our shock apparatus has been 
turned on. You are connected to this ap- 
paratus, During the following period 
you may receive a strong electric shock 
whenever the observers feel that your 
test performance is not up to eur stand- 
ards. (Red light snapped on.) Whenever 
the red light goes on, you are not meet- 
ing our standards and you are in danger 
of being shocked .... Like this! (Stand- 
ard shock of one second duration was 
administered through electrodes. Red 
light was turned off.) Now, pick up a 
pencil and look at the test blank before 
you. It is the same test you took just a 
few minutes ago. Your instructions are 
the same as before. At the signal ‘Go’ 
work as fast as you can until you are 
told to stop. Concentrate on your work. 
Remember, your reactions are being ob- 
served and continually photographed 
and you will be shocked whenever your 
test performance falls below our stand- 
ards. Get set for trial one. Go!”’. 

At 5 seconds from the Go signal, the 
red warning light went on and remained 


on until 5 seconds before the end of the 
usual 90 second trial. At this point a 
standard shock of 1 second duration 
was administered and the red light was 
turned off. Ninety seconds from the Go 
signal the recording instructed the sub- 
ject as follows: “Stop! Place the test 
you have just completed on the right 
side of the table. You will shortly be 
called upon to repeat the test. Remem- 
ber, you are being observed and contin- 
ually photographed and you will be 
shocked whenever your test perform- 
ance is below our standards. (Pause) 
Get set for trial two. Go!” The Go sig- 
nal for trial two was given 60 seconds 
after the Stop signal of trial one. Nine- 
ty seconds after the Go signal the Stop 
signal was given and the above instruc- 
tions and warning were repeated. The 
Go signal for trial three was given after 
60 seconds. The same red light and 
shocking procedure was carried out for 
all three trials. At the conclusion of trial 
three, the subject was informed, “The 
experiment is finished. Remain seated 
until the electrodes are removed.” The 
experimenter then entered the experi- 
mental room and reassured the subject. 
Before leaving, the subject was oriented 
as to the need for secrecy regarding the 
experimertal procedure. 


RESULTS 


Each Rorschach record was complete- 
ly scored according to the norms and 
standards established by Beck [5]. 
Form quality was determined by taking 
the F plus percentage for the entire rec- 
ord as well as F plus percentage for 
the color cards alone. Integration of 
ferm with color was determined by 
taking the sum of the conventional 
values of the various color responses 
and dividing the total by the number of 
color responses. In addition, each record 
was broken down and expressed in 
terms of a dichotomy between subjects 
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showing a trend toward FC (good in- 
tegration) and those showing a trend 
toward C (poor integration). This was 
done by placing all records having an 
average color value of .9 or less (CF 
tending toward FC) in the former cate- 
gory and those with an average color 
value of 1.0 or more (CF tending to- 
ward C) in the latter. 


The Digit Symbol Tests were scored 
using the formula: score number 
items correct. The average Digit Symbol 
Test score was determined for each sub- 
ject in the control period and the stress 
period by summing the results of each 
period and dividing by three (the num- 
ber of trials in each period). The aver- 
age stress score was algebraically sub- 
tracted from the average control score 
for each subject. The obtained differ- 
ence was taken as a representative 
measure of each individual’s approxi- 
mate decrement under stress. Decre- 
ment under stress in terms of percent- 
ages rather than the raw scores showed 
no significant difference in distribution 
and therefore was not utilized. A meas- 
ure of the maximum decrement or loss* 
under stress also was calculated for 
each subject by algebraically subtract- 
ing the lowest single score made under 
stress from the highest single score 
made in the control period. Correlation® 
between average and maximum decre- 
ment under stress showed a positive r 
of +.934 and suggested that a very high 
positive relationship existed between 
them. While this correlation is some- 
what spurious owing to the presence of 
common factors, it reinforced our selec- 
tion of Average Decrement under Stress 
as the quantitative measure most indica- 
tive of an individual’s relative loss of 
control in the experimental situation. In 
order to determine that Average Decre- 


° All correlations are product-moment unless 
otherwise indicated. 
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ment under Stress (loss of intellectual 
control) was not simply a function of 
performance level in the control period, 
a correlation between average control 
score and Average Decrement under 
Stress was computed. The r of +.055 
obtained here points toward little or no 
relation. 


TABLE I 
MEAN PERFORMANCE AND VARIABILITY OF THE 
EXPERIMENTAL GROUP 


Range 


Mean S&.D. 


Average Decrement 

under Stress 

F plus % of Total 
Record 

F plus % of Color 

Cards 

Integration of Form 

with Color 


25 (0-25) 10.36 5.70 


30(70-100) 81.56 6.59 


50(50-100) 75.48 9.28 


.7( 5 1.2) 88 .20 

Table I presents the extent: of varia- 
bility and central tendency of our ex- 
perimental population on the specific 
variables: under consideration. As may 
be noted, the distribution of Rorschach 
values appears to approximate those 
usually found in “healthy” populations. 


TABLE Il 


COMPARISON OF AVERAGE DECREMENT UNDER 
STRESS WITH RELATED RORSCHACH FACTORS 





(N = 25) r 

F plus % of Total Record —.606 

F plus % of Color Cards —.724 

Integration of Form 
with Color 


Dichotomy between Poor 
Integration and Good 
Integration 


+.3854 1.81 


+.425" 2.26 .0139 


4 Biserial correlation. 

t All probabilities were taken from the Student’s Table 
for small samples which covers only one tail of the dis- 
tribution [18]. Probability that t’s of the absolute size 
found would occur by chance may be obtained by doub. 
ling the P values shown. 


As may be seen from Table II, which 
presents the relationship between our 


criterion measure and the various Ror- 
schach factors under investigation, a 


~ 
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marked and highly reliable negative re- 
lationship is present between Form 
Quality (F plus percentage) and Aver- 
age Decrement under Stress. A some- 
what lower positive correspondence be- 
tween Form-Color Integration and 
Average Decrement under Stress ap- 
pears to be present and from t test re- 
sults may be said to be moderately reli- 
able at this level. 

To further examine the combined pre- 
dictive value of Form Quality and 
Form-Color Integration in relation to 
the Average Decrement under Stress a 
multiple correlation was run. The cor- 
relations obtained for F plus percentage 
in the color cards (—.724) and Inte- 
gration of Form with Color (+.354) 
were used. An intercorrelation of —.082 
was obtained for these factors sugges- 
ting little relationship between them in 
this population. Application of the 
Wherry-Doolittle technique for calcu- 
lating shrunken R resulted in a multiple 
correlation of +.824. Since the Wherry- 
Doolittle technique results in an unin- 
flated R, the high degree of predicta- 
bility suggested by an R of +.824 
appears both significant and reliable. 


CONCLUSIONS 


While the results obtained in this ex- 
periment are limited for purposes of 
generalization by our small and some- 
what homogeneous population, they do 
bear out the assumed relationship be- 
tween intellectual control as measured 
by the Rorschach and intellectual per- 
formance in an actual stress situation. 
Particular importance may be attached 
to the high and significant correlations 
between Form Quality in the Rorschach 
and performance under stress. The re- 
lationship between Form-Color Inte- 
gration and performance under stress 
is less definite, but again is in the ex- 
pected direction. The theoretical inter- 
pretation that poor integration of form 


with color in the Rorschach reflects 
poor control and non-efficient mental ac. 
tivity in the emotional situations of 
everyday life is borne out. Our high 
shrunken multiple correlation of +.824 
between the selected Rorschach factors 
and our criterion measure points to a 
high degree of combined predictive 
value for the two Rorschach categories 
investigated and is in line with the 
claims of Rorschach proponents. 

J The lack of significant correlation be- 
tween Form Quality and Form-Color In- 
tegration is interesting. At first glance 
this finding seems somewhat incongru- 
ous since, on an empirical basis, it 
would be expected that inefficient men- 
tal functioning and poor emotional con- 
trol should be highly related in stress- 
full situations. This is frequently ap- 
parent in clinical cases. However, the 
subjects utilized in our experiment were 
in a rough sense “normal” since they 
were able to make at least a minimum 
adjustment to their complex academic 
environment. As has been frequently 
noted, any decrement or inefficiency 
shown under stress is reflected in only 
one Rorschach sphere arid spreads to 
others as mental health is further im- 
paired. The correlation between the two 
Rorschach factors, Form Quality and 
Form-Color Integration, could thus be 
expected to be low in our “normal” ex- 
perimental group. Further experimental 
investigation of increased correlation 
with decreased mental health is sug- 
gested. 

From the standpoint of methodology 
our study indicates that it is possible to 
select well-defined Rorschach categories 
which can be compared with a be- 
havioral criterion established under lab- 
oratory conditions. While there are 
many difficulties to be overcome in at- 
tempting to set up controlled situations 
in the laboratory which even roughly 
duplicate theory and actual behavior, 
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the task is by no means impossible. It 
is our hope that the experimental design 
described herein will in the future be 
exposed to further investigation, repeti- 
tion and enlargement. Only by the ex- 
perimental confirmation of theory and 
empirical evidence, by better controlled 
and repeatable studies, will projective 
techniques achieve the scientific recog- 
nition they have lacked in the past. 
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HE PHYSICALLY handicapped 

individual is again the recipient of 
a great deal of attention. This was to be 
anticipated as an end-result of the war. 
However, the problems of those who 
suffer loss of function as a result of 
damage to their nervous systems, mus- 
cles, bones or joints, need hardly wait 
upon war. Thousands undergo trau- 
matic experiences at birth and there- 
after which leave them with physical 
limitations. 

Prominent among these disabling 
ailments is the neurotropic virus dis- 
ease, poliomyelitis, or as it is popularly 
known, infantile paralysis. Annually, 
thousands of boys and girls, men and 
women are infected by this agent. Dur- 
ing the twenty years, 1926 to 1946, 
there were 163,993 reported cases of pol- 
iomyelitis in the United States alone. 
Approximately 140,000 survived, among 
whom about 33 per cent have sustained 
some degree of visible physical limita- 
tion and many others are left with 
varying degrees of muscle weakness [1]. 

The psychological problems connected 
with physical limitations are of con- 
siderable importance. It was considered 
desirable to investigate the psychologi- 
cal elements in a sizeable sample of 


1 Aided by a grant from the National Foun- 
dation for Infantile Paralysis. 


2The authors wish to extend particular 
thanks to Mr. James R. Davidson and to Mrs. 
Constance Crail for their invaluable assistance 
and cooperation in the conduct of this inves- 
tigation. 


patients in whom initial hospital treat- 
ment and care were uniform. In the 
light of knowledge gained, it may be 
possible to improve the mental hygiene 
of the patient with a disabling illness. 


GENERAL DESCRIPTIVE DATA 


A group of 203 male and 234 female 
patients selected at random from the 
files of the Clinic of the Orthopedic 
Hospital, Los Angeles, were interviewed 
by trained hospital interviewers using 
a standard interview technique. All 
patients in the study were 16 years of 
age or over and had undergone treat- 
ment for infantile paralysis. All other 
factors such as sex, race, marital status, 
and employment were unselected. 

Age. Ages ranged from 16 to 43 with 
about 90 per cent of the entire group 
under 30 at the time of the study. The 
mean age of the group was approxi- 
mately 22 years. 

Age at Onset of Iliness. The age at 
onset of infantile paralysis is of inter- 
est in considering the psychological ef- 
fects of the illness upon the patient. Of 
the group studied here, approximately 
60 per cent were under the age of five 
when they had poliomyelitis, and 92.5 
per cent had it before their sixteenth 
birthday. This latter figure is probably 
high. A study of polio cases in the Chi- 
cago-Detroit area during 1939-44 shows 
only 82.7 per cent under 16. A similar 
study in 1942 in the northwestern states 
gave evidence of only 69.7 per cent in 
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this age group [1]. However, the fact 
that such a large group in this study 
had an early onset makes it more val- 
uable in indicating the psychological ef- 
fect of this disease upon children. 

Race. Ninety-five per cent of those 
interviewed in this study were of the 
white race. 

Marital Status. At the time of the 
study, 23.7 per cent of the men and 29.5 
per cent of the women were married, 
and an additional 4 per cent of the men 
and 11.6 per cent of the women plan to 
be married shortly. The Metropolitan 
Life reports [2] state that the average 
age at first marriage (for the early 
part of the fourth decade of the twen- 
tieth century) is about 26 for males and 
23 for females. 

Mental Status. Estimates of intellec- 
tual competency were made on the basis 
of intelligence tests administered for 
the most part several years after onset 
of poliomyelitis. For the males, the up- 
per quartile of intelligence quotients 
was at 110; the lower quartile at 95 and 
the mean at 102. The females’ upper 
quartile was 107, lower quartile at 94 
and the mean at 103. There is no evi- 
dence of any marked impairment of 
mental function suggested by these find- 
ings. 

The mental status of the patients 
studied was found to play a role in their 
plans only to the extent that one would 
anticipate in a similar segment of the 
general population. The brighter, more 
intellectual individuals showed a deter- 
mination to continue with training in 
colleges or professional business schools 
while those on the duller side had al- 
ready terminated their educational ef- 
forts. 

PHYSICAL FACTORS 

Residual Physical Involvement. The 
degree of residual physical involvement 
is of importance in appraising its psy- 
chological effects. At the time of this 
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preliminary investigation, only about 
four per cent of the patients studied had 
emerged from their illness and convales- 
cence without residual paralysis. Great 
care must be exercised to avoid misin- 
terpreting this observation. These pa- 
tients were drawn from the files of a 
clinic caring for patients primarily in 
need of continued medical treatment. 
Therefore, those without residual paral- 
ysis had no reason to continue atten- 
dance at the clinic and were not includ- 
ed in this study. More comprehensive 
records at the National Foundation [1] 
reveal that roughly fifty per cent of all 
patients with infantile paralysis emerge 
without visible disablement although 
some muscular weakness may be pres- 
ent. 

In the group investigated, about fifty 
per cent had severe involvement in 
which the residual paralysis constituted 
a major limiting factor, not alone from 
the standpoint of difficulties in locomo- 
tion and the necessity for using correc- 
tive appliances, but also because their 
disability is visible to the casual onlook- 
er. This figure corresponds to a 20 to 25 
per cent frequency of severe crippling 


TABLE I 
PHYSICAL INVOLVEMENT 
MALE FEMALE 

ETERS I Ree epee ae 41.9% 45.0% 
ET IIE edccnscdibicichixouintohnge 13.8 14.1 
| RE ee errs 3.0 5.6 
One or both legs & trunk.. 13.8 14.1 
Left arm or hand ............ 4.9 1.3 
Right arm or hand ......... ,° = 2.1 
Both arms or hands ........ 1.5 9 
One or both legs, trunk 

and left arm or hand . 3.9 3.5 
One or both legs, trunk 

and right arm or hand. 4.9 6.9 
One or both legs, trunk and 

both arms and hands 4.5 3.0 
No residual paralysis 3.9 3.5 

100.0 100.0 
N 203 234 

Severe involvement 48.3 


53.2 
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in the total population of poliomyelitics 
and has been reported elsewhere [1]. 
Table I indicates the distribution of 
physical involvement, and Table II 
shows the requirements of these patients 
for orthopedic appliances. 


TABLE II 
NEED FOR ORTHOPEDIC APPLIANCES 


MALE FEMALE 





No appliance required ...... 46.3% 42.8% 
| 4 1.3 
Braces — one ..........-.2.-..--. 10.9 8.5 
Braces — two or more .... 5 
| ESSE Seen eee 4.0 3.0 
REE eee a en ree ee 1.5 
Wheelchair and braces ... 1.9 1.3 
Braces and crutches or 

RI ici, Micia hid elanihcimgesiii 13.3 14.9 
Shoe extension only .......... 18.2 22.2 
a 3.0 6.0 

100.0 100.0 
N 203 234 





Of great importance to psychological 
adjustment is the degree of apparency 
of the deformity. The disabilities of 
about 45 per cent of the patients were 
classed as very or moderately apparent, 
and of 30 per cent as slightly apparent, 
while those of 25 per cent were either 
nonapparent or absent. Obviously, de- 
formities that may be only slightly ap- 
parent or nonapparent in a man because 
of his clothing, may be quite visible in 
a woman. 

The investigation has revealed some 
interesting sidelights on the effect of 


TABLE III 
PER CENT DISTRIBUTION OF MALES AND FE- 
MALES WITH REFERENCE TO SEVERITY OF 
PHYSICAL LIMITATION AND RE- 
PORTED SOCIAL ADJUSTMENT 








Little or no Satisfactory or 





social life better than satis- 
factory social life 
Per cent Per cent 
Male Female Male Female 
Severe limitation 15.4 10.9 84.6 89.1 
Non-severe 
limitation 7.3 9.4 


92.7 90.6 





physical limitations upon the capacity 
for social adjustment. Table III is a 
comparison between severely disabled 
and nonseverely disabled men and wom- 
en in the study. 

Jt is interesting to note that less than 
four per cent of all the patients studied 
“prefer to associate” primarily “with 
other physically handicapped individ- 
uals’. Among the non-severely disabled 
the desire to do so was expressed by only 
0.5 per cent while severely disabled wom- 
en reported a wish to so limit their 
association in 3.7 per cent of the cases. 


VOCATIONAL FACTORS 


Employability. Many factors enter in- 
to determining whether an individual! 
will be employed. Unfortunately, among 
those who are disabled, visible physical 
limitations are frequently overweighted. 
The capacity for the job and the ability 
of the individual to render efficient ser- 
vice in a normal environment, are often 
overlooked or ignored. Individuals with 
minor alterations in capacity but with 
obvious deformities are discriminated 
against by prospective employers. A 
prognosis of employability was made 
on all the patients in this study, and is 
indicated in Table IV. 











TABLE IV 
PROGNOSIS OF EMPLOYABILITY 
Le es MALE FEMALE 
Not restricted .................... 17.7% 16.38% 
IIE, | witbachtbhiicti sie cicesres 51.3 52.1 
Very restricted .................. 25.6 22.1 
Questionable ........................ 1.9 3.0 
Might earn living at 
self-made job .................. 3.0 3.9 
Not employable .................. 5 2.6 
100.0 100.0 
N 203 234 





One should not blame all of the dif- 
ficulties in securing employment upon 
the limitations evolving out of polio- 
myelitis. Twenty-six and one-half per 
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cent of the males and 28.2 per cent of 
the females had physical deficiencies 
above and beyond those resulting from 
infantile paralysis. Other prominent 
factors were inadequacies in personali- 
ty and mental ability, which accounted 
for barriers in employment aside from 


deformities in two-thirds of this cate- 


gory of patients. 

Employment and Disability. At the 
time of the initial investigation, 44 per 
cent of the males and 18 per cent of the 
females were gainfully employed. We are 
shortly to commence a resurvey to as- 
certain the employment situation on a 
post-war basis, the degree of lay-off and 
related employment data. The relatively 
poorer record of the women in this re- 
spect can be accounted for in part by the 
fact that nearly 30 per cent were mar- 
ried and did not seek employment out- 
side their household. Actually, they may 
be considered as employed although we 
did not so categorize them in this report. 

A comparison was made between the 
degree of physical involvement and the 
prognosis of employability. While re- 
strictions of employability varied direct- 
ly with the severity of deformity, less 


} than 8 per cent of all the patients were 


so severely limited that they required 
some special consideration for employ- 
ment. Only 1.7 per cent of the patients 


TABLE V 
PERCENTAGE DISTRIBUTION OF MALES AND FE- 
MALES ON BASIS OF EMPLOYMENT AND 
PROGNOSIS OF EMPLOYABILITY 








Unrestricted Restricted Very restricted 


M F M F M F 

Full-time 

employment 54% 16% 41% 17% 31% 15% 
Part-time 

employment 6 0 11 5 “ 6 
Attending 

school 34 58 31 29 31 29 
Unemployed—not 

attending 

school 6 10 17 23 21 23 
Not seeking 

work 0 16 0 26 2 27 





100 100 100 =6100 100 §=100 
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in our study could be categorized as 
true unemployables. In Table V are the 
percentage distributions of men and 
women on the basis of their employment 
status as related to the prognosis of em- 
ployability. 

It is particularly worthy of note that 
only “very restricted” males, and then in 
only 2 per cent of the cases in that cate- 
gory, “were not seeking work”. Among 
females the number was greater but 
hardly more than would be expected in 
a similar section of the general popula- 
tion. Full-time employment seems to 
vary directly with the degree of physi- 
cal restriction. About 20 per cent of the 
restricted and very restricted males 
were, at the time of the preliminary 
study, neither working nor taking train- 
ing. 

It is apparent that the individual with 
a good educational background is con- 
siderably better off in securing employ- 
ment. None of the unemployed were col- 
lege graduates, while 15 per cent of the 
employed were in this category. Below 
the college level, however, job attain- 
ment seems to depend upon other fac- 
tors for the two groups; employed and 
unemployed do not appear very differ- 
ent from each other. 

Employed patients have a modest but 
definite superiority in reported intel- 
ligence quotients. The employed group 
has an inter-quartile range (IQ) from 
91 to 105 with a mean of 99, while the 
unemployed show an interquartile range 
from 87 to 100 and a mean IQ of 92. 
While the differences are not great, they 
are constant and reveal a definite super- 
iority of mental status in the employed 
patients. The employed and unemployed 
groups do not include the subjects 
classed as students, who had a higher 
average IQ. 

As Table VI shows, there is little re- 
lationship between employment and the 
apparency of deformity. Although those 


34 


whose disability is not apparent seem 
slightly more able to secure jobs, it is 
evident that many with severe physical 
limitations have positions, presumably 
because they possess other needed quali- 
fications. Examination of Table VII re- 
veals that about half of the employed 
males and forty per cent of the em- 
ployed females wear no appliances. The 
remainder of both sexes successfully ob- 
tained employment, although many use 
crutches, braces, or shoe extensions. 


TABLE VI 

A COMPARISON OF EMPLOYED AND UNEM- 
PLOYED GROUPS ON THE BASIs OF 

APPARENCY OF DEFORMITY 


Degree of 
Apparency 





Employed 
N % 


50 37.3% 


. Unemployed 
N 





Very apparent 
Moderately 

apparent 
Slightly apparent . 
Not apparent 


15 
38 
31 


134 


11.2 
28.4 
23.1 


41 39.4 


104 100.0 


100.0 





It is quite clear that female patients 
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show a greater frequency of “very ap 
parent” disabilities than males, due ty 
the necessity for more frequent utiliza. 
tion of appliances plus the fact that 
their clothing fails to hide these devices, 

The Role of Surgery in Vocation] 
Readjustment. The intelligent use of 
surgery can do a great deal toward over. 
coming the restrictions and the visible 
defects of poliomyelitis. Such surgery 
should be introduced whenever the in. 
dications are medically favorable and 
when they may overcome psychological, 
social and vocational barriers that oth- 
erwise would prevent the patient from 
leading a normal life. 

Among the patients in the present 
study we found that 72.7 per cent of the 
males and 75.9 per cent of the females 
felt that “surgery improved chances for 
securing employment.” About 56 per 
cent of all our patients included in the 
sample were considered as having re 
ceived their major improvement from 
surgical treatment. Of this group 84 per 
cent of the men and 86 per cent of the 


TABLE VII 


PERCENTAGE DISTRIBUTION OF APPARENCY OF DISABILITY COMPARED WITH 
. _ PROSTHESIS Usep By MALES AND FEMALES IN THE EMPLOYED GROUP 








~ Prosthesis 





Apparency 


| No Appliances 
One Brace 





| 
| 


Two Braces 


Chair and Brace 
Brace and Crutches 


Crutches 
Shoe Extension 





MALES 
Very Apparent 
Mod. Apparent 
Slightly Apparent 
Not Apparent.................... 4 


— 
o 90 
ow mo 


22.0 
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Very Apparent 
Mod. Apparent. 
Slightly Apparent 
Not Apparent 
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) omen reported that surgery “helped a 
; lot in securing employment”. 
® This finding would certainly argue 
for serious consideration of surgical in- 
Niervention when indicated. One may 
question the willingness of patients to 
undergo such treatment since it involves 
a good deal more stress and strain on an 
already heavily burdened individual. 
However, 42.3 per cent of the men and 
851.1 per cent of the women were “will- 
5 ing to undergo further surgery if neces- 
sary to improve their condition”. The 
' readiness to undergo such operative pro- 
) cedures did not vary to any significant 
} degree with the severity of the involve- 
i ment. Those who were considered as 
having relatively nonsevere involve- 
ments were only slightly less willing to 
| undergo operations if they would im- 
prove their outlook. Patients with in- 
) volvements of both legs or of leg and 
} trunk were the most anxious to accept 
» such treatment. 


TABLE VIII 
MAIN REASON FoR NOT WORKING 
THoseE Not IN ScHOOL Nor EMPLOYED 








FEMALE 
31.6% 


MALE 
22.0% 





No available jobs 

Lack of specific training, 
experience, ete. .............. 

Physical disability 


43.9 35.1 
5.3 
Employer’s objection 
to handicap ' 3.5 
24.5 


100.0 
57 








In contrast it is interesting to ob- 
serve the reasons given by the unem- 
ployed group for their failure to secure 
employment. This group consisted of 
104 patients who were not attending 
any kind of educational institution on a 
regular basis. This is summarized in 
Table VIII. Forty-four per cent of the 
unemployed males gave as the reason 


for unemployment “lack of training, ex- 
perience or influence’. About three- 
fourths of the men who gave this rea- 
son were in the “restricted” category of 
employability. This emphasizes, on the 
one hand, the need for exploration of vo- 
cational potentialities and improved 
training techniques introduced early in- 


‘to the patient’s hospital and convales- 


cent experience and, on the other, should 
supply the orthopedic surgeon with im- 
petus for reducing restrictions by opera- 
tive procedure whenever possible. 
Again, 22 per cent of the males reported 
no “available jobs’, and here four-fifths 
of the group were in the “restricted” 
class for employment. 

Most of the unemployed females were 
“occupied with home duties”, and really 
should be considered as fully employed. 
About 75 per cent of those who remain 
at home are in “restricted” or “very re- 
stricted” categories. Only 17 per cent of 
the women base their inability to obtain 
employment on “lack of training or ex- 
perience.” 

Among the most significant findings 
are the replies to the query “What is 
your most perplexing personal prob- 
lem ?”. The distribution of replies is in- 
dicated in Table IX. It is a significant 
trend that the unemployed handicapped 
individual devotes relatively little atten- 
tion to factors other than “getting a 
job” and “fears about future security,” 
while the employed patient is much 
more reticent in stating his personal 
problems, is “worried about making 
enough money”, and is even more wor- 
ried than the unemployed about his fu- 
ture security. This indicates that fol- 
lowing employment, the patient may be 
expected to battle his own feelings of in- 
security not only because of actual limi- 
tations produced by his physical defi- 
ciencies but also because his earnings 
are frequently insufficient to meet his 
needs in a normal life situation. This is 


. 
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an area in which preventive mental hy- 
giene is indicated. Earlier and closer 
coordination between the physician, 
psychologist, and vocational guidance 
and placement workers would seem not 
only warranted but essential. 


TABLE IX 
COMPARISON OF EMPLOYED AND UNEMPLOYED 
GrRoUPs WITH REFERENCE To MOsT PER- 
PLEXING PERSONAL PROBLEMS 
REPORTED ON CHECK-LIST 





‘Unemployed Employ 
%o %o 


10.6% 24.6% 





No response 
Getting a job 
Making enough 
27.0 
Social Popularity .. 5 3.7 
Inferiority feelings 4 8.2 
Family relationship ; 3.0 
3.7 
Fear of future 
21.6 
8.2 


134 100.0 





104 100.0 





The question often arises regarding 
the exploitation of physically handi- 
capped people who enter industry. Our 
preliminary study shows the trend has 
been for those with physical restrictions 
to get into “dead end” jobs or jobs with 
“limited opportunity for advancement’. 
Only about one-fifth of our patients had 
at the time of interview found em- 
ployment in jobs with definite oppor- 
tunities for self-advancement. This may 
be explained in part by the fact that only 
19 per cent of the subjects had se- 
cured employment in large corporations. 
The vast majority had gone into sma!l 
business concerns or public and civil 
service where opportunities are not 
great. 

Ninety-eight per cent of our patients 
reported little or no interference with 
their work from their physical limita- 
tion. This is supported by their employ- 
ment history in which 91 per cent of the 


working group with all categories of 
physical limitations were “secure jy 
their jobs”. 

There was aslight differential in aver. 
age weekly earnings between those who 
had little or no physical restriction ang 
those with rather marked restrictions, 
This amounted to an average of only 
about 7 per cent less per week. This js 
due to the need for more severely hand- 
icapped to accept a less desirable type of 


employment or to go into business for 


themselves where they earn smaller 
weekly pay but at the same time in- 
crease their capital by reinvesting it 
within their own business. 


SOCIAL ADJUSTMENT 


The social adjustments of the unen- 
ployed and employed groups are con- 
pared in Table X. 


TABLE X 
COMPARISON OF EMPLOYED WITH UNEMPLOYED 
Groups IN SOCIAL ORIENTATION 


Employed 








Unemployed 
N % N % 





No social life T 5.2% 
Very meager 
social life 
Fairly normal 
23.1 
Satisfactory social 
34.5 
Completely normal 
social life 13.5 


104 100.0 134 100.9 





Those who were in the employed group 
either had made a better social adjust- 
ment as a result of their employment or 
were well adjusted before they began 
looking for employment. This problem 
is being investigated at this time. In all 
probability, both factors are operating 
simultaneously. 

Marriage and Adjustment. With re 
gard to the marital plans expressed by 
the group, it was found that 16.7 per 
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® cent of the females and 6.4 per cent of 
the males who had severe physical in- 
© volvements reported that this factor had 
actually “influenced their marital plans 
7 unfavorably”. On the other hand, 41 per 
cent of the females and 28 per cent of 
|} the males were married or planned to 
be married regardless of severity of 


© physical disability. The remainder of- 


) the patients were not contemplating 
» marriage because of other temporarily 
= more important factors such as com- 
) pleting educational careers or family 
) responsibilities. 
A comparison was made of marital 
) plans in relation to other factors indica- 
tive of social adjustment. For example, 
employed men and women who were 
} married tend to avoid getting into “dead 
» end” jobs and are found more frequent- 
| ly than single men and women in jobs 
with “opportunity for advancement”. 


Only 25 per cent of the employed mar- 
ried men and women were engaged in 
“dead end” jobs, while 75 per cent of 
unmarried men and women were occu- 
pied in such positions. 

Another interesting observation was 
that while 81 per cent of the married 
men and women made a good social ad- 
justment as indicated by their report of 
an adequate social life, only 32 per cent 
of those who had considered themselves 
as having “no opportunity for mar- 
riage” felt that they had achieved a 
satisfactory or normal social relation- 
ship. 
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A COMPARISON OF ONE UNSUCCESSFUL WITH 
FOUR SUCCESSFUL NONDIRECTIVELY 
COUNSELED CASES 


By WILLIAM U. SNYDER 


PENNSYLVANIA STATE COLLEGE 


HERE HAVE been more than a 

dozen published cases of successful- 
ly conducted nondirectively counseled 
treatments. Muench [4] and Combs [1] 
have shown that successful outcomes 
of treatment by this method can be dem- 
onstrated by the use of standard per- 
sonality tests administered before and 
after treatment. Up to the present, how- 
ever, there has been little investigation 
of the unsuccessful use of nondirective 
procedures. 


PROCEDURE 


This study is not an analysis of the 


frequency of failures, but an effort to 
compare by statistical and other means 
one such failure with two other cases 
successfully counseled by the same coun- 
selor, and with two cases successfully 
counseled by two other counselors. The 
unsuccessful case was counseled by the 
writer between the times that his two 
successful cases were counseled. It was 
phonographically recorded in the man- 
ner described by Covner [2]. The same 
counselor’s other two cases were partial- 
ly phonographically recorded. The two 
cases counseled by other psychologists, 
and used here for purposes of compari- 
son, were entirely phonographically re- 
corded. Two of the four comparison 
cases have appeared in full in print 
[5, 6], a third has appeared in part [3], 
and the fourth has been accepted for fu- 
ture publication [8]. 

The criteria by which the unsuccess- 
ful case was considered to be so were 
the following: At the end of treat- 


ment both the counselor and the client 
agreed that the seven interviews had not 
been successful in producing any desir. 
able change of attitude on the part of 
the client. The client expressed dissatis- 
faction with not having been given any 
answers to his problem. The client 
stated in the last interview, 


I mean, as far as I am concerned, I haven't 
accomplished anything. I mean, I’ve already 
known these things. I haven’t accomplished 
anything. These things are here, and I’ve pre- 
sented them and that’s: all—all there is to 
_ ee ae 


He also expressed the idea that while 
some progress might have been made on 
the question of whether he could return 
to school the next semester, he felt that 
many of his major problems had not 
been covered. He said, 


This is temporary—the others have been 
permanent. It’s still there—(he means his 
general confusion) it’s permanent until it’s— 
well, proven otherwise. I have to go one way 
or the other. 


Later he justified his demand for some 
sort of advice, saying, 


Because I’ve tried and I’ve failed to cor- 
rect all these things, so therefore the only 
other possible way is with some advice or 
some other means of solution or solving the 
problem. That’s why I—as far as I’m con- 
cerned, it’s—I can’t do it myself—I know that, 
because I’ve tried—and tried as much as an 
individual—a person can. 


The four cases used for comparison 
were judged to be examples of success- 
ful nondirective counseling by three 


judges who were trained clinical psy- 
chologists. 


- 
=< 
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The five cases were analyzed accord- 
ing to the method previously described 
by the writer [7]. Each idea expressed 
was classified into one of seventeen cate- 
gories of counselor’s statements, or of 
twelve categories of client’s statements. 
In addition, the emotional tone of the 
client’s statements, where apparent, was 


classified into one of nine categories. All 


of these categories are indicated in 
Table I. A check on the reliability and 
validity of the classification was made 
© in two ways; a sample of the interviews 
was rechecked by the same classifier, 
and a different sample was categorized 
by another classifier who was at that 
time untrained in nondirective methods. 
These checks indicated that the classifi- 
cations were highly reliable. The fre- 
quencies for each category in the unsuc- 
cessful case were then compared by 
means of individual chi squares with 
those of the two successful cases by the 
same counselor, and of the two success- 
ful cases by other counselors. 


RESULTS 


Table I gives a summary of the chi 
squares obtained, expressed in terms of 
whether or not they attained a two per 
cent probability of significant differ- 
ence. A plus or minus sign shows wheth- 
er the category of statement occurred 
significantly more or less frequently in 
the unsuccessful case than in the suc- 
cessful ones. A zero is used to indicate 
that the unsuccessful case did not differ 
| significantly from the successful cases 
in respect to the amount of each cate- 
gory thus marked. When the unsuccess- 
ful case differed from the successful 
ones, but no more than they appeared to 
differ from each other, it was considered 
that the difference between unsuccessful 
and successful cases was purely a 
chance variation resulting from person- 
al characteristics of the counselor, and 
these categories were marked with an 


asterisk. 

Table I also shows the actual percent- 
ages of some oi the counselor and client 
categories which make up the cases. In 
the unsuccessful case 70.9 per cent of 
the counselor’s statements are nondirec- 
tive, and of this amount 53.8 per cent 
are composed of the two categories, 
simple acceptance and clarification of 
feeling. Only 19.6 per cent could be 
called directive. For the control cases, 


TABLE I 
COMPARISON OF THE PERCENTAGES OF FRE- 
QUENCIES, AND THE SIGNIFICANCE OF THE 
CH1 SQUARES OF THE REAL DIFFERENCES, 
For VARIOUS COUNSELOR AND CLI- 
ENT CATEGORIES IN THE UNSUCCESSFUL 
CASE AND THE Two GRouPs OF SUCCESS- 
FUL CASES 











Structuring ....................... 
Suggesting topics 
Direct questions 
Nondirective leads 
Simple acceptance 
Restatement of content... 
Clarification of feeling... 
Interpretation -—................. 
Approval & 
encouragement .............. 
Information ....................-.. 
Proposing activity 
Using persuasion .............. 
Using criticism .............. 
Discussing ending 
i 
Ending of treatment 
Friendly discussion 
Unclassifiable ................... 








CLIENT CATEGORIES 


Percentages 
A 3&3: < 


Statement of problem .... 31.5 33.2 33.4 
Asking for information . 3.2 2.7 
Answer to question 18 09 
Accepting counselor's 
Rejecting ditto 3.5 
Understanding & insight 24.4 
Discussion of plans 
Ending of contact ........ 
Ending of treatment 
Not related to 

the problem ......... 
Friendly discussion 
Unclassifiable —............... 





elo w 


17.7 


e+||+e 





+o+ 

















A COMPARISON OF NONDIRECTIVELY COUNSELED CASES 


TABLE I (continued) 
CLIENT FEELING CATEGORIES 


Percentages P? 
A B C 





No feeling ....................... 36.8 31.2 49.1 
Pos. attitude toward self 13.6 17.7 6.9 
Pos. att. toward counselor 3.2 1.2 2.0 
Pos. att. toward other 

persons or events ..... 4.0 3.2 2.0 
Negative attitude 

toward self -5 32.7 26.9 
Negative attitude 

toward counselor . 02 3.8 
Negative attitude 

toward others .......... 11.2 6.1 5.1 
Ambiv. att. toward self... 3.2 
Ambiv. att. toward 

GOURGEEE  cemccecacenne 98 
Ambiv. att. toward 
All positive attitudes ..... 20.8 
All negative attitudes 
All ambivalent attitudes 4.4 
All attitudes toward self.. 42.3 
All att. toward couns. ... 5.3 
All att. towards others —.. 15.6 











KEY: 

A column gives the percentage of responses of this type 
in successful cases by the same counselor. 

B column gives the percentage of responses to this type 
in successful cases by other counselors. 

GC column gives the percentage of responses of this type 
in the unsuccessful case. 

A’ column indicates the comparison of the unsuccessful 
case to the two successful cases by the same coun- 
relor. 

B’ column indicates the comparison of the unsuccessful 
case to the two successful cases by other counselors. 

+ means that the chi-square of the difference was sig- 
nificant (P of less than .02) and that the frequency 
for the unsuccessful case was greater than for the 
successful. 

— means that the chi-square of the difference was sig- 
nificant, but that the frequency in the unsuccessful 
case was lower than in the successful. 

0 means that there was no significant difference shown. 

* means that any difference shown between successful 
and unsuccessful cases was not greater than the dif- 
ference between the two sets of successful cases, 
and therefore, purely a chance variation. 


the percentages of nondirective re- 
ponses were 67.6 and 65.2, and the per- 
centages of directive statements were 
22.0 and 26.0. The unsuccessful case i 
equally as nondirective as the others. 
In considering the percentage of fre- 
quency of the various client categories, 
five are particularly interesting: 9.3 per 
cent of the responses were asking for in- 
formation, 6.1 per cent were rejection of 
a statement of the counselor, and 11.8 


per cent were material irrelevant to the 
problem. Only 8.5 per cent were under. 
standing or insight, and only 0.7 pe 
cent were discussion of plans. This 
client, therefore, differed considerably 
from the control clients in type of reae. 
tions. 

Observing Table I, we may draw 
a number of conclusions about the con. 
trast between the unsuccessful and the 
successful cases. In the unsuccessfy] 
case the counselor employed significant. 
ly more the techniques of structuring, 
asking direct questions, and restating 
the content of the client’s remarks, and 
significantly less those of interpretation 
and approval and encouragement. It 
would seem that he was attempting to 
use more of those techniques which 
occur in the setting up of the counseling 
process, or the describing of what takes 
place in a nondirective interview, than 
was true in the successful cases. It also 
appears that he more frequently re 
stated merely the content of what the 
client was saying. This may be due to 
the fact that the client was expressing 
less feeling, and spending more of his 
time on irrelevancies, to which little 
clarification of feeling was possible. We 
also find that the counselor spent some- 
what less time encouraging the client 
than was true in the successful cases. 
This should not be too quickly interpre- 
ted to mean, however, that more encour- 
agement and approval would have pro- 
duced a more favorable outcome. This 
may be true, but we have observed else- 
where’ that approval and encourage- 
ment in the nondirective interview is 
used most frequently following a state 
ment of insight or a discussion of plans 
on the part of the client. It is legitimate 
to assume, therefore, that if little in- 
sight or discussion of plans took place, 
there would be less incidence of approv- 
al and encouragement. In the unsuccess- 


1 An unpublished study made by the writer. 
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ful case the client did show significantly 
less insight, or discussion of plans than 
the most successful cases showed. 

Next we note that the procedures 
which the client used significantly more 
often in the unsuccessful case were ask- 
* ing for information, rejecting the coun- 
selor’s statements, discussing the ending 
of the series of interviews, and discus- 
sing irrelevant material*. All of these 
categories represent either the client’s 
outright refusal to accept the nondirec- 
tive structuring, an attempt to discon- 
tinue the counseling process, or an at- 
tempt to avoid the counseling by escap- 
ing into nonrelated material. Study of 
the protocols themselves shows this even 
more obviously than do the statistical 
data. Also, an analysis of the type of 
feelings expressed by the client reveals 
that fewer feelings in general were ex- 
pressed than by the clients whose coun- 
seling turned out successfully ; although 


one type of feeling, the expression of 
negative or ambivalent attitudes toward 
the counselor or the process of counsel- 
ing, occurred more frequently than in 
the successful cases. 


DISCUSSION 


It seems appropriate to ask the ques- 
tion, “Just why was this case unsuccess- 
ful?” The statistical study of the part 
played by the counselor does not offer 
much in the way of tangible differences 
between this case and the others. True, 
there were more of structuring and ask- 
ing of direct questions, and there were 
less of interpretation and approval and 
encouragement; but on the whole these 
differences in technique appear to be the 
result of what the client was doing, rath- 
er than the cause. It is in the analysis 
of the client’s part in the interview that 
we seem to find the indications of what 
caused the difficulty. And even here, an- 

? An example of this irrelevant material is, 


“Who is that fellow in the hall? What’s his 
name?” 


alysis of the frequency of occurrence of 
certain categories, as found in Table I, 
is really only indicative of the unfavor- 
able outcome, as revealed in the lack of 
understanding and insight or discussion 
of plans, rather than of the nature or 
cause of failure. 

In reading through the protocol better 
answers to this question seem to be 
found. We feel that several factors in- 
dicate that this client was not an ap- 
propriate subject for counseling. First, 
it is not at all clear just what the client’s 
problem was. He described several rath- 
er general symptoms, i.e. that he was 
ineffective, confused, and unable to 
think clearly, that he experienced “un- 
real’’ sensations, and that he felt that he 
lacked stability. Two somewhat more 
tangible symptoms mentioned were that 
his grades seemed to be going down, and 
that he had a fear of failure. The client 
revealed that he hoped to enter the 
school of dentistry the following semes- 
ter, but was not sure that his grades 
would be high enough for admission. In 
the last interview he revealed that if he 
was not admitted to dental school he 
would be eligible to be drafted immedi- 
ately. He expressed the feeling that he 
could not be of any use to his country 
because of his present mental state, and 
that he might become worse from army 
experience, but also he felt sure his 
emotional problem would not be recog- 
nized by the examining medical board 
as sufficient reason for deferrment from 
service. 

Second, there appeared throughout 
the case a very real uncertainty as to 
whether this client was able to verbal- 
ize his problems enough to profit from 
counseling. His general speech was 
vague; he seldom completed ideas he 
started to express, and he found it al- 
most impossible to give examples of the 
symptoms he described in such general 
terms. He frequently discussed topics 
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unrelated to his problems. 

That this client may not have been an 
appropriate subject for counseling is 
also suggested by the fact that he re- 
ported during the counseling that he had 
been treated by two psychiatrists in the 
past, but that they had not been able to 
help him. He complained that they told 
him there was nothing much wrong with 
him, and that he should just forget him- 
self for awhile and think about other 
people. 

Fourth, this client seemed unable to 
face the underlying problems, and to ex- 
press his true feelings about them. This 
is indicated by the fact that less than 
the usual percentage of his responses 
showed either positive or negative atti- 
tudes or feelings, either toward himself 
or toward others. 

Another possible reason for the lack 
of success in this case may havc been the 
client’s insistence on having the coun- 
selor give him some advice or criticism, 
and the counselor’s refusal to do so. 
During the fourth and fifth interviews 
the counselor and client became em- 
broiled in a mild debate over whether 
the counselor should or should not give 
advice. The counselor consistently re- 
fused, but the client was just as firm in 
insisting that “That’s what a doctor 
does, and a psychologist is a sort of doc- 
tor.” Rogers has since expressed the 
opinion that it is not well to make such 
an issue of being nondirective that it be- 
comes a battle with the client as to what 
method is to be used. There are ways of 
making minor concessions and giving 
highly general “advice” without be- 
coming in any way really directive.’ If 
the counselor had followed this tech- 
nique, it is possible that this very crit- 

3 An example of such general advice is the 
following: “You seem to be uneasy about your 
grades. It might be good to try to analyze the 


reasons for their being low and then try to 
correct that condition.” 


ical hurdle could have been much more 
easily crossed. 

One final aspect of the case may 
have had a contributory relationship to 
its failure. Throughout the interviews 
the client was keenly interested in the 
note-taking, which he readily accepted, 
However he also regularly asked the 
counselor if it might be possible for him 
to receive a typed copy of the notes. In 
the final interview the client indicated 
he would like to have the notes so he 
could show others just “how he was” at 
present. There would seem to be some 
possibility, therefore, that to remain 
neurotic was not undesired by this 
client, and that a record of his inter. 
views would have served as proof of his 
condition, perhaps to a draft board. If 
such a goal could have existed in the 
mind of the client, it is questionable 
whether he would have recovered under 
any method of treatment, directive or 
nondirective. 
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THE INCOMPLETE SENTENCES TEST AS A 
METHOD OF STUDYING PERSONALITY’ 
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' TN THE Army Air Forces Convales- 
iat Hospitals a serious need was felt 
for a screening test, that could be given 

= to large groups, to evaluate adjustment 

» in terms of psychological fitness for re- 

turn to duty. Such a technique was need- 

ed for the initial evaluation of patients, 

but was required more importantly as a 

measure of improvement while in the 


hospital. The more structured tests, such 
as the personality inventories, did not 
= appear to be sufficiently discriminative, 
and easily scored projective tests, such 
as the Multiple-Choice Rorschach, have 
not stood up under experimental inves- 
tigation in the armed forces. 


To fill the need presented, a semi- 
structured technique, the Incomplete 
Sentences Test, was adapted to the spe- 
cific purposes described above. The in- 
complete sentences technique has a long 
history in psychology as a measure of 
language ability and intelligence. Its 
present-day use as a method of study- 
ing the personality of individuals seems 
to have begun with Payne [2] in 1928 
and Tendler [4] in 1930. Methods of 
scoring or analysing the technique as a 
personality instrument have been sub- 
jective for the most part with the ex- 
ception of a study by Lorge and Thorn- 


‘This study was conducted as a part of the 


Army Air Forces Aviation Psychology Pro- 
gram. 
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dike [1]which used single word re- 
sponses. The original forms worked with 
in this study were used in the armed 
forces by Max L. Hutt, Joel Shor, Jules 
D. Holzberg, and others. 

Rohde [3] recently published a study 
involving the use of the incomplete sen- 
tences method with adolescent school 
children. Since most previous scoring 
has been subjective and dependent upon 
unusual clinical skill, one of the pur- 
poses of this study was to devise a meth- 
od of scoring which would provide con- 
sistent results with relatively untrained 
scorers. This report describes the de- 
velopment and evaluation of this meth- 
od. 

A preliminary form of the scale, 
which consisted of 50 items selected 
on an a priori basis, was administered 
to patients who were later interviewed 
with the object of evaluating their test 
responses. Items which were not dis- 
criminative were eliminated, and others 
were included when additional measures 
of specific attitudes were needed. Origi- 
nal items were also changed to give 
more freedom of response, and extreme- 
ly ambiguous items such as “I ....”, 
and “Sometimes ....”, were added. The 
final form of the test included 40 items, 
shown in Figure 1. The average time of 
administration was 20 minutes. The in- 
structions used are also shown in Figure 
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1. Preliminary investigation indicated 
that these instructions were superior to 
forms that asked the subject to respond 
quickly or with the first thought that 


came to his mind, as such directions 
tended to produce a relatively high per. 
centage of single word and association 
answers. 


INCOMPLETE SENTENCES TEST 
COMPLETE THESE SENTENCES TO EXPRESS YOUR REAL FEELING. TRY To Do Every 
ONE. BE SURE To MAKE A COMPLETE SENTENCE! 


The happiest time ..... 

I want to know 

Back 

I regret 

At bedtime ; 
NS ica ntans achaecep hdaiecacs saad tns alanis alee 
The best ........... pr oe: aoe ee ; 

What annoys me 


© 90 STM OP 


- eB eee ; 
My nerves 

Other people 

I suffer 


22. The most dangerous ....................... 


23. 
24. The future 
i eR a ee : 


ell ee eee 
ee OU Te winnie 

Sometimes 

WS I ID baits nciesniesinsncstccinn. 

This hospital 


The only trouble 


an ETE atielatieiatalge ; ia 
CO Se , 


My greatest worry is 
3S a 


FIGURE 1. The final form of the test. 


METHOD OF SCORING 

All responses were grouped into three 
categories: (1) conflict or unhealthy 
responses; (2) positive or healthy re- 
sponses; and (3) neutral responses, Al- 
though conflict, positive, or neutral re- 
sponses could take several forms, it was 
felt that scoring each kind separately 
would not be justified and would unduly 
complicate the scoring technique. For 
example, some of the conflict responses 
included hostility reactions, symptom 
elicitations, and recall of unpleasant 
past experiences. Some of the positive 
responses included humorous, optimis- 
tic, and acceptance reactions. 

An earlier method of scoring included 
separate consideration of “avoidance re- 
actions”, which were defined as re- 
sponses in which the subject failed to re- 
late the stimulus to himself as instruc- 


ted, but made a neutral reply. Examples 
of such responses are: “Back 

is the opposite of forward’, and 
“What pains me . . . . is this test.” 
An original hypothesis that such be 
havior, along with humorous and flip- 
pant remarks, might be correlated with 
maladjustment was quickly dispelled. In 
fact, such answers appeared with great- 
est frequency in the best adjusted sub- 
jects. It was also thought that omissions 
bespoke great conflict, but again a great- 
er frequency of omissions in the more 
maladjusted subjects was not found. It 
would appear that many of the best ad- 
justed subjects were saying in effect 
that their private feelings were “none 
of your business.” This latter finding is 
of considerable significance for the scor- 
ing and interpreting of many personal- 
ity tests. 
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Conflict, neutral, and positive reac- 
ions were located on a single dimension 
o that each test response could be given 

numerical score of +3 to +1 for con- 
ict responses, 0 for neutral responses, 
»nd —1 to —3 for positive responses. To- 

| scores thus had a possible range of 
+120 to —120. The actual range found 


to —34. It is evident that a plus score in- 
jicates conflict or maladjustment, while 
2 minus score indicates adjustment. 
= Total scores were obtained by alge- 
Wraically adding the scores for the 
Stems. In spite of encouragement by the 
Mexaminer to complete all statements, 
Ssome patients failed to complete numer- 
wus items. For the purpose of this study, 
pall test blanks with less than 16 scorable 
responses were eliminated. Omissions 
Bwere not scored, and the formula: 40 / 
(40 — omissions) X total score for the 
items answered was used for computing 
final scores. 
A scoring booklet with examples of 
typical responses for the numerical 
scoring of each item was developed. Two 
types of criteria were used in selecting 
S cxamples for weighting responses to the 
different categories. The first type of 

criterion material was obtained from 
ithe responses of 45 patients whose be- 
havior was easily classified. Fifteen of 
these patients were serious psychiatric 
cases with evidence of pre-military mal- 
adjustment. A second 15 patients gave 
no evidence of pre-military maladjust- 
ment, and their current psychological 
disturbances followed severe combat ex- 
perience. The third 15 patients were 
considered to have no serious psycholo- 
gical problems. Most of the latter had 
been hospitalized for orthopedic diffi- 
culties. The second type of criterion for 
classifying responses was based on gen- 
eral principles of adjustment and on 
the experience of the authors. 

The general rules for numerical scor- 


nies a pesiiah ceil inane 


‘ith the 200 patients studied was +71 ° 


ing of the Incomplete Sentences Test are 
stated below. Examiners had about four 
hours of supervised training in applying 
these rules to sample tests. 


General Rules for Numerical Scoring of the 
Incomplete Sentences Test 


1. Omission responses are those for which 
no answer is given or for which the thought 
is incomplete. 

2. “C” or conflict responses are those indi- 
cating an unhealthy or maladjusted frame of 
mind. 

3. “P” or positive responses are those in- 
dicating a healthy or hopeful frame of mind, 
or the expression of humor. 

4. “N” or neutral responses are those not 
falling clearly into either of the above cate- 
gories. They are generally on a simple deé- 
scriptive level. Responses such as “Most girls 

. . are females”, which evade the purpose 
of the test, are usually scored as neutral. 

5. Deviations from the above generaliza- 
tions may occur and examples will be listed 
in the scoring manual. 

6. The scoring manual is to serve as a 
guide to be followed as closely as possible. It 
is not expected that all responses will be found 
in the scoring manual, but typical responses 
for each of the different numerical weights are 
given. 

7. Each response is to be scored and evalu- 
ated independently of all others. 

8. Examples are not given for extreme 
weights (+3 or —3) in some items, usually 
because extreme responses to those items are 
rare. These weights may be assigned, how- 
ever, if clearly warranted. 

9. Where precedent for scoring a given re- 
sponse cannot be found in the examples for 
that item, scoring for a similar response to 
another item may be used. 


+ 


Samples of the scoring examples for 
three items are presented below. 


Examples of Scoring Standards 

Item 15. Iean’t ... 

C,. Watch people die; stand the army; sleep 
nights; concentrate; think straight 

C,. sit still; stand hot weather; do much 

C,. understand army inefficiency; do heavy 
lifting; express my thought 

N. (do some specific skill like type or spell 
or mechanics) 

P,. complain; 
get married 


like this place; wait until I 


‘ 
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P,. be in two places at one time 

P,. eee 

Item 19. Other people 

C,. laugh at me; are no good 

C,. talk too much; should mind their own 
business; annoy me; irritate me; I envy; get 
on my nerves; just have worries; are happier 

C,. have their worries too; are in the same 
boat 

N. are different; some good and some bad 

P,. are entitled to their own opinions; get 
along with me; usually like me; amuse me 

P,. are OK; are friendiy; are interesting 

P,. are swell 

Item 24. The future 

C,. is black; I have no future; is hopeless 

C,. not good; worries me; is dark 

C,. is questionable; is at home; is blank; 
depends on getting out of the army 

N. is yet to come; is undecided 

P,. better than past; is before me; is good, 
I hope; holds a great deal in store; is some- 
thing to plan for 

P,. bright; very bright; OK; good 

P,. looks wonderful 


METHOD OF EVALUATING THE TEST 
The test was evaluated using data 


from 200 unselected patients admitted 
to the AAF Convalescent Hospital, 
Camp Davis, N. C., during the period 
from June to August, 1945. 

Reliability. The following methods 
were used to determine the reliability 
of the test. One psychologist scored all 
200 records. Items were divided into 
two categories on an a priori basis to 
comprise roughly equivalent halves. 
Scores on the two halves were correlat- 
ed by the product-moment method. 

As a measure of the inter-scorer re- 
liability seven psychological assistants 
each scored the same 50 records. Pro- 
duct-moment intercorrelations of total 
scores for each pair of scorers were 
computed. 

Validity. To determine the validity of 
the test the psychologist’s initial eval- 
uation of the severity of disturbance of 
each patient was used. The judgment of 
the psychologist during the initial inter- 
view was based upon the following data: 


(1) case history information; (9) 
health and personality inventories ; (3) 
admission diagnosis; (4) a test of mep. 
tal dysfunctioning; and (5) a psycho 
logical interview. The psychologist’; 
judgment of the patient’s condition was 
expressed by classifying the patient jy 
one of three groups: Group I include 
those patients considered psychological. 
ly fit for for immediate return to duty; 
Group II included those considered psy. 
chologically unfit for immediate return 
to duty but who should benefit from con. 
valescent care; Group III included those 
patients considered too disturbed for 
further service in the Army, and those 
so seriously disturbed as to warrant ree- 
ommendation for immediate psychi- 
atric attention. Data used to establish 
scoring standards were not included in 
the criterion groups. 


RESULTS 


Test Reliability. The test reliability 
of .85 (corrected by the Spearman- 
Brown prophesy formula) was ob- 
tained. This is probably a conservative 
estimate of “true” test reliability since 
the equivalence of test items assigned 
to the two halves was determined solely 
by inspection. 

Interscorer Reliability. Correlations 
of total scores assigned to 50 records by 
the seven scorers are given in Table 1. 


TABLE I 


INTERSCORER RELIABILITIES FOR SEVEN SCOR- 
ERS ON THE INCOMPLETE SENTENCES 











Scorer 

238.92 11: 

22.32 

23.02 

28.75 

¢ 25.04 

81 d 25.70 

M8 -. 23.10 





It can be seen that agreement is uni- 
formly high, although one scorer (F) 
had consistently poorer agreement. The 
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nverage intercorrelations for the seven 


B.-orers (computed by using Fisher’s z) 
Ras .89; with scorer F eliminated, it 


yas .91. The scorers’ formal training in 
ysvchology ranged from one with a col- 
ege major in journalism and military 
experience in psychology to one with an 
M. A. degree in psychology followed by 
teaching experience. (Scorer F was rel- 
atively well trained in psychology). 
Thus the results in Table I indicate that 
the test may be reliably scored by indi- 
viduals without extensive training in 
psychology. 

Validity. The validity of the test for 
predicting severity of disturbance is 
given in Table II. 


TABLE II 


RELATIONSHIP BETWEEN PSYCHOLAGIST’S JUDG- 
MENT OF SEVERITY OF DISTURBANCE AND 
ScorEs ON THE INCOMPLETE 


Judgment N M s re r 

Psychclogically fit 

fe 64 3.27 
Il. Psychologically un- 

fit for duty at 

a 85 
Ill. Seriously disturbed 51 
All Patients ................... 200 


14.40 
33.96 


20.08 21.07 61 -05 





* Tri-serial r based upon the formula for biserial +f 
from widespread classes from C. C. Peters, and W. R. 
Van Voorhees, Statistical procedures and their mathe- 
matical bases. New York: McGraw Hill, 1940, pp. 384- 
391. 


| The coefficient of .61 indicates that the 


test provides an effective means for es- 
timating the severity of the patients’ 
psychological condition. Since the test 
can be administered on a group basis 
and scored semiobjectively, it offered a 
valuable means for screening patients 
in need of psychiatric attention at the 
time of the initial evaluation. 


SCORING BY OVERALL EVALUATION 


The second test of validity and inter- 
scorer reliability was made with 148 
subjects at the AAF Convalescent Hos- 


pital, Cochran Field, Georgia, where the 
test was scored by independent overall 
subjective judgment of two experienced 
clinical psychologists? on a four point 
scale of no, mild, moderate, and severe 
disturbance after general inspection of 
the complete test. These ratings were 
compared with the admitting diagnosis 
6f either psychiatric or non-psychiatric 
complaints. 

The results of these ratings are given 
in Table III. 


TABLE III 


RELATIONSHIP BETWEEN PSYCHIATRIC DIAGNO- 
Sis AND RATINGS ON THE INCOMPLETE 


Psychiatric 
(N=80) 


Total 
(N=148) 


Non-Psychiatric 
(N=68) 

SE 

Mean Rating SDt Toia oie 

2.10 -98 -41 07 

2.13 91 39 .07 


Mean Rating 
A 2.74 
B 2.69 





The two scorers had an interscorer re- 
liability of .68 and their bi-serial cor- 
relations with the criterion of admitting 
diagnosis were .41 and .39. Although 
the criterion of the admitting diagnosis 
is probably weaker than the validity cri- 
terion used for the evaluation of the ob- 
jective scoring, the lower interscorer re- 
liability suggests that validity would be 
lower than that of the objective scoring 
even if the same criterion had been 
used. 


FURTHER APPLICATIONS 


The incomplete sentences technique 
seems applicable to a number of other 
screening problems. Experienced psy- 
chologists can devise special items and 
derive scoring examples for many spe- 
cific purposes, following the general pro- 
cedures described. The method shows 
potentiality as a means for-studying at- 
titudes in which freedom of response 


2 Grateful acknowledgment is made to Dr. 


Nicholas Hobbs who with the junior author 
made the ratings and aided in the planning of 
this part of the study. 


. 
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and reasonably objective scoring can be 
combined. In the military situation, 
this test threw much light on the 
patients’ attitudes toward the hospital, 
the “caste system,” and the army in gen- 
eral. More formal studies of this poten- 
tiality are now in progress. 
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THE USE OF PSYCHOMETRIC INSTRUMENTS 
IN PSYCHOLOGICAL CLINICS 
BY 
C. M. LOUTTIT 


SAMPSON COLLEGE 
AND 
C. G. BROWNE 


THE OHIO STATE UNIVERSITY 


; primes OF the large number of 


psychometric instruments available 


| today, it is obviously impossible to train 


students in the use of all of them. There- 


‘fore, in most programs designed for 


training in clinical testing, it has 
seemed wise to restrict the training to 
certain specific tests covering the entire 
range of the various types of tests. In 
order to secure data regarding the in- 
struments in most common use in clin- 
ics, questionnaires were sent to 31 uni- 
versity clinics listed in the report in the 
May, 1946, issue of The American Psy- 
chologist, and to 28 additional clinics of 
different types. From this number, 43 
completed returns were received and 
are included in the survey report. No 
follow-up letters were mailed. 

The final returns of 43 institutions 
are divided as follows: colleges and uni- 
versities, 22; psychiatric hospitals, 6; 
public Schools, 3; juvenile research 
activities, 2; child guidance clinics, 2; 
children’s homes, 2; training schools, 2; 
counseling and adjustment services, 2; 
public clinics, 1; research institute, 1. 
While this sampling is heavily weighted 
with colleges and universities, it is like- 
ly that the techniques and clinical meth- 
ods being used in other types of clinics 
will be affected by what is being used in 
colleges, and vice versa. 


PRESENTATION OF DATA 

From Table I, a summary of the 43 
returns may be compared with the re- 
sults of the survey of clinical tests pub- 
lished in 1935 [1]. It is assumed that 
there were approximately 49 cases in 
the earlier study, since this is the num- 
ber reporting the use of the 1916 Re- 
vision of the Stanford Binet test. 

The tests in Table I are arranged in 
descending order of the total number of 
times they were mentioned in the 1946 
returns. Column 1 indicates this num- 
ber of mentions for each test, and Col- 
umn 2, the number of times these tests 
were mentioned in the 1935 returns. 
Columns 3 and 4 indicate the order of 
the tests in the 1946 and 1935 studies, 
on the basis of the number of times 
each was mentioned. Where several 
tests have been mentioned an equal 
number of times, the midpoint of their 
places in the order scale has been as- 
signed to each test. The present survey 
asked for an indication ef frequency of 
use in three categories: (1) for tests 
used in the majority of cases; (2) for 
those frequently used; and (3) for 
tests used only as needed in a particular 
case. In weighting the tests, a value of 
8 points was assigned for a check in 
column 1; 2 points for a check in column 
2; and 1 point for column 3. The fre- 
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quencies in each category are shown in tests which were mentioned at least four 

columns 7, 8, and 9, while the total times in either the 1946 or the 1935 

weighted score is given in column 5,and_ study. This means that approximately 

the rank by weighted score in column 6. 10 per cent of the reporting clinics were 
Table I includes the names of all using the tests. 


TABLE I 

SUMMARY OF PSYCHOMETRIC TESTS USED IN PSYCHOLOGICAL CLINICS 

N (1935)—49 

N (1946)—43 
Total | Total | 1946 | Mentions Per agge 
Mentions | Mention | Weights {| Column—1945 finne: 
Order | | hipley 

Name of Test 1946 |1935| 1946 | 1935] Wt. [Order] 1 

“SS {SLs Pate erei 


Stanford Binet, 1937 Revision 43 | | 112 | 29 
Stanford Binet, 1916 Revision ms | | | —|— 
Wechsler-Bellevue 41 | é | 103 23 
Goodenough Draw-A-Man 36 | | 3.5 | 74 10 
Thematic Apperception 36 | 3.5 | 6 
Rorschach Psychodiagnostic 34 | 
Stanford Achievement 34 
Otis Self-Administering 33 
Gray Oral Reading 32 
Strong Vocational Interest —................ 31 
Healy P.C.—II 30 
Ishihara Color Blindness 30 
30 
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Porteus Maze a 
Vineland Social Maturity 3 
Arthur Performance 29 
Minnesota Multiphasic 29 
Kent-Rosanoff Free Association ........| 27 
Bell Adjustment Inventory .................. 26 
RE Se .| 26 
Bernreuter Personality -................... .| 25 
California Personality 24 
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| Total | Total | 1946 | 
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— 20 | 53 
8.5 25 | 40.5 
28.5 | 21 | 48.5 
_ 18 | 56 
12 21 | 48.5 
— 15 | 60.5 
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In addition to the tests listed in Table 
I, these were seven tests mentioned 
three times, 33 tests mentioned twice, 
and 119 tests mentioned once, in the 
1946 study. A list of these is available 
from the authors. 


COMPARISON OF 1935 AND 1946 STUDIES 


Even a brief analysis of some of the 
changes in relative rank held by cer- 
tain tests provides an interesting por- 
trayal of the changes in the practice of 
clinical psychology during the past ten 
years. The following tests were listed as 
the nine most frequently used by clinics 





in the 1935 study; Stanford Revision 
(1916), Porteus Maze, Arthur Perform- 
ance, Healy P.C.-II, Pintner-Paterson, 
Stanford Achievement, Merrill-Palmer, 
Gesell, and Kuhlmann-Anderson. Of this 
group only two are included in the first 
nine tests in the 1946 study: The Stan- 
ford Revision (1937) and the Stanford 
Achievement. The Wechsler-Bellevue, 
Goodenough Draw-A-Man, Thematic 
Apperception, Rorschach Psychodiag- 
nostic, Otis Self-Administering, Gray 
Oral Reading, and Strong Interest 
Blank complete the group of the top 
nine tests in the 1946 study. The Por- 
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T .eus Maze drops to 12th place, Arthur 
* Performance to 15.5, Pintner-Paterson 
Sito 54, Merrill-Palmer to 28.5, Gesell to 


22, Healy P.C.-II to 12, and Kuhlmann- 
Anderson to 47.5. 

There are two tests in the top nine of 
the 1946 study which had not been pub- 


S lished in 1935, namely the Wechsler- 


Bellevue and Thematic Apperception. 


= The Rorschach Psychodiagnostic, al- 


though published, was not widely known 
in this country. Undoubtedly this group 
has come into general use because of 


| the great need for an adult intelligence 


scale, and the growing use of projective 
techniques in clinical work. 

Changes in Clinical Practice. The gen- 
eral changes in the top nine tests be- 
tween the two studies is strongly in- 
dicative of the general shift which has 
occurred in clinical practice. For ex- 


' ample, the 1935 top nine included four 


individual tests measuring verbal ca- 
pacities, intended for use with children 
and adolescents. In addition, there were 
four performance tests or scales which 
are also measures of abilities. The list 
included one achievement test, and none 
for personality. 

In 1946, however, we find quite a dif- 
ferent picture. There are three intelli- 
gence tests in the top 9, but only two of 
them are individual tests and they meas- 
ure individuals at different age levels, 
namely, the Stanford Revision and the 
Wechsler-Bellevue. The other intelli- 
gence test is the Otis Self-Administer- 
ing. It is significant to note that, when 
weighted scores are considered, the Otis 
drops to tenth place, and the Arthur 
Performance Scale takes a position 
among the top nine tests. Performance 
is being measured most frequently at 
the upper adolescent and adult level by 
the use of the Wechsler-Bellevue, and 
at the children’s level by the Good- 
enough Draw-A-Man, when a single 
test is used. Personality and emotional 


behavior have assumed an important 
place as shown by the widespread use 
of the Rorschach Psychodiagnostic and 
the Thematic Apperception. The use of 
the Gray Oral Reading indicates the 
growing recognition of reading prob- 
lems and their relationship to deviating 
behavior, and the Strong Vocational In- 


‘terest Blank in ninth place shows the 


extension of clinical work into measure- 
ment of a wider variety of factors and 
into a wider field of activity. 

Performance Test Use. There has 
been considerable shifting in the use of 
various performance tests and scales. 
The Arthur Scale was in third place 
with 26 mentions in 1935. However, in 
1946, the Arthur has dropped to 15.5 
place, although it has 29 mentions and 
is still the most widely used perform- 
ance scale. A large shift is noted in the 
Pintner-Paterson Scale. The Cornell- 
Coxe Scale, published in 1934 and 
therefore not in the 1935 returns, is in 
31.5 place in 1946, with 21 mentions. 
The use of such individual performance 
tests as the Goodenough Draw-A-Man, 
Kohs Block, Knox Cube, and Manikin 
has increased greatly since 1935. 

General Changes in Use. For other 
wide deviations in the use of a test, re- 
ference may be made to the Kent E-G-Y, 
Vineland Social Maturity Scale, Minn- 
esota Multiphasic, Kent-Rosanoff Free 
Association, Meier-Seashore Art Judg- 
ment, Otis Intelligence, Healy P.C.-I, 
Stenquist Mechanical Aptitude, Ben- 
nett-Fry Mechanical Comprehension, 
Kuhlmann Binet Revision, Terman 
Group, and the Thurstone and Califor- 
nia Personality. 

Relationship of Number of Mentions 
and Order. A comparison between the 
relative number of mentions and the 
order in the group between 1935 and 
1946 reveals some interesting differ- 
ences. The Stanford Revision, which 
was in first place in both studies, had 


‘ 
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49 mentions in 1935 and 43 in 1946. 
However, in 1935, the second place test, 
the Porteus Maze, had only 27 men- 
tions ; whereas in 1946, the second place 
test, the Wechsler-Bellevue, had 41 men- 
tions. The ninth test in 1935 had 20 
mentions; whereas the ninth test in 
1946 had 31 mentions, and a test with 
only 20 mentions in 1946 occupies 33.5 
place. The tests with four mentions, the 
lowest number included in Table I for 
each study, occupy 97.5 place in 1946, 
but 61.5 in 1935. 

Weighted Scoring. It was anticipated 
that the weighted scoring would give a 
better picture of certain tests in terms 
of their importance in clinical use, 
rather than simply the number of times 


that they were used. In general, hoy. 
ever, the place of each test on the 
weighted scale does not vary widely 
from its place on the number-of-me. 
tions scale. All of the tests in the top 
nine on the basis of the number of mep. 
tions also appear in the top nine o 
weights, with the exception of the Otis 
Self-Administering which drops from 
seventh to tenth place. The Arthur Per. 
formance Scale is included in the top 
nine of the weighted scores in 7.5 place 
compared with 15.5 place on the number 
of mentions. 
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